Commit Graph

7 Commits (a87f6284007a2c4062016041c612fd0a86c2fafd)

Author SHA1 Message Date
gongjy a8ae342775 Update data preprocessing methods 2024-09-27 16:19:30 +08:00
gongjy b4359b3335 fix data_process bug 2024-09-23 20:11:19 +08:00
Yu Chengzhang 6fb569abd8 修复了process_seq_monkey写入错误的bug 2024-09-23 18:34:58 +08:00
gongjy bf64ffb056 update data_process 2024-09-22 21:17:05 +08:00
gongjy 7115a98453 update data_process Chunk_size Read 2024-09-21 22:57:22 +08:00
gongjy 56c6139896 update data_process & full_sft 2024-09-13 13:32:24 +08:00
gongjy 8be42693f6 MiniMind first open source 2024-08-28 16:41:44 +08:00