Commit Graph

10 Commits (e5bc1001578ad83c7316c4defcac7ffa5f679b46)

Author SHA1 Message Date
gongjy aca94aa137 update data_process 2024-10-23 12:25:45 +08:00
gongjy 62bed77a70 update data_process 2024-10-23 12:02:28 +08:00
gongjy 0fbeba5e5d update data_process 2024-10-12 18:47:08 +08:00
gongjy f351a61c8a Update data preprocessing methods 2024-09-27 16:19:30 +08:00
gongjy 4b8df4a7e0 fix data_process bug 2024-09-23 20:11:19 +08:00
Yu Chengzhang 19a2428b60 修复了process_seq_monkey写入错误的bug 2024-09-23 18:34:58 +08:00
gongjy 44813d5f85 update data_process 2024-09-22 21:17:05 +08:00
gongjy 8f0fd7affc update data_process Chunk_size Read 2024-09-21 22:57:22 +08:00
gongjy 700412704c update data_process & full_sft 2024-09-13 13:32:24 +08:00
gongjy 8be42693f6 MiniMind first open source 2024-08-28 16:41:44 +08:00