Commit Graph

326 Commits (428f017e21c93cc96dccac0a28ec700c01270ba4)

Author SHA1 Message Date
jingyaogong 428f017e21 [update] image 2026-04-04 14:54:13 +08:00
jingyaogong ef1c130a03 [update] readme 2026-04-04 11:25:21 +08:00
jingyaogong 7546729893 [update] open causal 2026-04-02 15:28:58 +08:00
jingyaogong 6512d5647a [update] readme 2026-04-02 15:28:29 +08:00
jingyaogong ea57409fd2 [update] readme 2026-04-01 14:00:21 +08:00
jingyaogong d52691f2e3 [update] default model 2026-03-31 13:40:16 +08:00
jingyaogong 5e9d15614e [update] random seed 2026-03-27 21:20:02 +08:00
jingyaogong 8f3169dba2 [update] fp16 inference 2026-03-27 16:29:46 +08:00
jingyaogong deed5674c4 [update] image 2026-03-26 15:35:42 +08:00
jingyaogong 2c24568176 [update] change default seq_len 2026-03-26 10:09:06 +08:00
jingyaogong b24fcdc1f9 [update] minimind-3 2026-03-25 23:57:45 +08:00
jingyaogong 855a169582 Merge pull request #698 from readlnh/master
[fix] 修复训练脚本中 1-indexed step 与 0-indexed 逻辑混用的问题
2026-03-24 13:41:20 +08:00
readlnh c88c497795 [fix] align log/save last-step check and ETA with 1-indexed step 2026-03-24 02:01:40 +01:00
readlnh 9fe4343b7b [fix] gradient accumulation step alignment 2026-03-24 01:45:04 +01:00
jingyaogong f798445826 [update] empty_think_ratio 2026-02-06 19:15:21 +08:00
jingyaogong 533814ea2d [update] empty_think_ratio 2026-02-06 01:36:02 +08:00
jingyaogong ec6a14c65d [feat] data process 2026-02-06 01:17:57 +08:00
jingyaogong 69180447af [update] save interval 2026-01-30 20:30:50 +08:00
jingyaogong 9c1f4325f8 [update] safe half 2026-01-30 20:29:31 +08:00
jingyaogong 3d2f03cfff [fix] data skip 2026-01-18 16:56:29 +08:00
jingyaogong f0aa3ba52e [update] shuffle data 2026-01-18 16:39:34 +08:00
jingyaogong 17be26f5b9 [fix] max length 2026-01-17 13:26:14 +08:00
jingyaogong 33b0dfbec5 [update] pretrain load 2026-01-17 12:00:17 +08:00
jingyaogong b832bd5253 [update] align mask 2026-01-15 11:20:41 +08:00
jingyaogong b189f0046a [update] align loss 2026-01-15 00:56:32 +08:00
jingyaogong caf76fb884 [fix] compile unpack 2026-01-14 20:13:32 +08:00
jingyaogong 6ef2105e34 [feat] add compile 2026-01-14 14:42:30 +08:00
jingyaogong f0f73a208e [update] prompt prefill 2026-01-13 17:46:54 +08:00
jingyaogong 2dafa1f3bc [update] show speed 2026-01-07 23:33:47 +08:00
jingyaogong 379983849e [update] params log 2026-01-07 23:08:45 +08:00
jingyaogong 649328b932 [update] mask log 2026-01-07 22:12:26 +08:00
jingyaogong b3486a72d7 [update] readme 2026-01-07 00:58:38 +08:00
jingyaogong b64fddfdff [update] simplify loader 2026-01-06 01:20:52 +08:00
jingyaogong 3b062dad24 [update] readme 2026-01-06 01:18:10 +08:00
jingyaogong 6bea38c741 [update] rename train tokenizer 2026-01-06 01:17:33 +08:00
jingyaogong ba8448bd20 [update] readme 2026-01-05 23:15:25 +08:00
jingyaogong cb6be70365 [update] rename reason 2026-01-05 23:12:29 +08:00
jingyaogong 4138d7584c [fix] messages num 2026-01-04 11:03:16 +08:00
jingyaogong dbfeff23e3 [fix] dist cleanup 2026-01-02 22:25:55 +08:00
jingyaogong 3c56aca1c1 [update] aux loss 2026-01-01 22:41:46 +08:00
jingyaogong 5b87b9ad8a [fix] experts unused 2025-12-31 21:47:04 +08:00
jingyaogong e82af4bf8f [fix] layers set 8 2025-12-31 21:06:37 +08:00
jingyaogong 1c333636c5 [fix] moe unused 2025-12-31 21:00:06 +08:00
jingyaogong 73a2bcc412 [feat] get params 2025-12-31 20:46:59 +08:00
jingyaogong 759036b822 [feat] get params 2025-12-31 20:44:34 +08:00
jingyaogong 8ace03f068 [feat] update config 2025-12-31 10:29:13 +08:00
jingyaogong 6ee867fffc [feat] update lr 2025-12-31 10:27:09 +08:00
jingyaogong cc40ff6f45 [feat] compatible tokenizer 2025-12-31 10:26:46 +08:00
jingyaogong bc6f6dea99 [feat] stream load data 2025-12-28 16:58:52 +08:00
jingyaogong fc2eeff509 [feat] remove empty_cache 2025-12-27 07:14:36 +08:00