8972dab6f5
fix sft resume with compile mode
...
Load checkpoint state before torch.compile to avoid key mismatch on resume, and make optimizer/scaler restore tolerant to missing fields in older checkpoints.
Made-with: Cursor
2026-03-19 12:44:53 +00:00
fea69cf338
[fix] data skip
2026-01-18 16:56:29 +08:00
f7ffdf1fdb
[update] shuffle data
2026-01-18 16:39:34 +08:00
c090b69c4d
[update] align loss
2026-01-15 00:56:32 +08:00
e119db8478
[fix] compile unpack
2026-01-14 20:13:32 +08:00
81d24a4f16
[feat] add compile
2026-01-14 14:42:30 +08:00
42a4e8c86a
[fix] dist cleanup
2026-01-02 22:25:55 +08:00
9d898576ac
[update] aux loss
2026-01-01 22:41:46 +08:00
c65335b56f
[fix] experts unused
2025-12-31 21:47:04 +08:00
bc8fd82166
[fix] layers set 8
2025-12-31 21:06:37 +08:00
5dd4df7e18
[fix] moe unused
2025-12-31 21:00:06 +08:00
6242980917
[feat] update lr
2025-12-31 10:27:09 +08:00
7eae14f3ce
[feat] remove empty_cache
2025-12-27 07:14:36 +08:00
fe24501602
[feat] adjust seq length
2025-12-14 20:41:58 +08:00
5e1447b913
[fix] cuda memory #559
2025-12-01 16:17:43 +08:00
6b86ea399a
[feat] release memory
2025-11-27 19:39:49 +08:00
509d8dacf1
[feat] clear cache
2025-11-06 13:12:28 +08:00
bf123b585d
[feat] add args
2025-10-30 10:05:12 +08:00
1713c24114
[fix] model device
2025-10-29 10:36:28 +08:00
8f7e07b8ef
[feat] update trainer
2025-10-28 23:30:10 +08:00
e8484874f5
[feat] pause-training
2025-10-26 18:49:52 +08:00
a82526da11
[feat] shuffle data
2025-10-23 20:13:28 +08:00
805744e60a
[fix] loss-issues-430
2025-10-23 19:08:42 +08:00
463044e92a
[fix] sampler-ddp
2025-10-23 15:03:19 +08:00
fa7dff8291
[fix] graph-oom & ddp-pos_cis
2025-10-23 14:22:13 +08:00
7d877db79b
[feat] minimind-2510
2025-10-21 21:19:47 +08:00
caae54a89e
fix bugs
2025-04-29 20:45:39 +08:00
29454c31af
fix bugs
2025-04-27 09:56:49 +08:00
a62faf34bd
250426
2025-04-26 10:05:47 +08:00
王得利
jingyaogong