Commit Graph

31 Commits (29c87cfc8daedc32fc34d3aabae3e164564031b8)

Author SHA1 Message Date
jingyaogong 568a863520 [fix] bugs 2026-04-21 13:03:34 +08:00
jingyaogong e612cc26e8 [fix] lora compile 2026-04-10 00:01:21 +08:00
jingyaogong 862dd151f2 [fix] lora moe 2026-04-09 16:36:48 +08:00
jingyaogong b703844a60 [update] add a comment 2026-04-09 15:09:58 +08:00
jingyaogong b24fcdc1f9 [update] minimind-3 2026-03-25 23:57:45 +08:00
readlnh c88c497795 [fix] align log/save last-step check and ETA with 1-indexed step 2026-03-24 02:01:40 +01:00
readlnh 9fe4343b7b [fix] gradient accumulation step alignment 2026-03-24 01:45:04 +01:00
jingyaogong 69180447af [update] save interval 2026-01-30 20:30:50 +08:00
jingyaogong 3d2f03cfff [fix] data skip 2026-01-18 16:56:29 +08:00
jingyaogong f0aa3ba52e [update] shuffle data 2026-01-18 16:39:34 +08:00
jingyaogong b189f0046a [update] align loss 2026-01-15 00:56:32 +08:00
jingyaogong 6ef2105e34 [feat] add compile 2026-01-14 14:42:30 +08:00
jingyaogong dbfeff23e3 [fix] dist cleanup 2026-01-02 22:25:55 +08:00
jingyaogong 3c56aca1c1 [update] aux loss 2026-01-01 22:41:46 +08:00
jingyaogong 5b87b9ad8a [fix] experts unused 2025-12-31 21:47:04 +08:00
jingyaogong 1c333636c5 [fix] moe unused 2025-12-31 21:00:06 +08:00
jingyaogong fc2eeff509 [feat] remove empty_cache 2025-12-27 07:14:36 +08:00
jingyaogong dacd4e5121 [feat] adjust seq length 2025-12-14 20:41:58 +08:00
jingyaogong cafc3b22df [feat] release memory 2025-11-27 19:39:49 +08:00
jingyaogong 86d5cc70ec [feat] clear cache 2025-11-06 13:12:28 +08:00
jingyaogong ccab16a9b9 [feat] add args 2025-10-30 10:05:12 +08:00
jingyaogong 230b29b94a [fix] model device 2025-10-29 10:36:28 +08:00
jingyaogong cd576b58e8 [feat] update trainer 2025-10-28 23:30:10 +08:00
jingyaogong 43726a7c34 [feat] pause-training 2025-10-26 18:49:52 +08:00
jingyaogong 8d1778a186 [feat] shuffle data 2025-10-23 20:13:28 +08:00
jingyaogong 3658bdb20d [fix] loss-issues-430 2025-10-23 19:08:42 +08:00
jingyaogong 1e4f464553 [fix] sampler-ddp 2025-10-23 15:03:19 +08:00
jingyaogong faec18117e [fix] graph-oom & ddp-pos_cis 2025-10-23 14:22:13 +08:00
jingyaogong 249fb5b7ef [feat] minimind-2510 2025-10-21 21:19:47 +08:00
jingyaogong 5343923e0f update lora 2025-04-27 15:45:06 +08:00
jingyaogong e74843bd09 250426 2025-04-26 10:05:47 +08:00