Commit Graph

8 Commits (0fbeba5e5dbcb6f7a920090c98b55a992a879e75)

Author SHA1 Message Date
gongjy 0fbeba5e5d update data_process 2024-10-12 18:47:08 +08:00
gongjy f351a61c8a Update data preprocessing methods 2024-09-27 16:19:30 +08:00
gongjy 4b8df4a7e0 fix data_process bug 2024-09-23 20:11:19 +08:00
Yu Chengzhang 19a2428b60 修复了process_seq_monkey写入错误的bug 2024-09-23 18:34:58 +08:00
gongjy 44813d5f85 update data_process 2024-09-22 21:17:05 +08:00
gongjy 8f0fd7affc update data_process Chunk_size Read 2024-09-21 22:57:22 +08:00
gongjy 700412704c update data_process & full_sft 2024-09-13 13:32:24 +08:00
gongjy 8be42693f6 MiniMind first open source 2024-08-28 16:41:44 +08:00