Commit Graph

77 Commits (f4d34d38e77bc2ea14e36c4ec0112267a5e5f909)

Author SHA1 Message Date
jingyaogong 6242980917 [feat] update lr 2025-12-31 10:27:09 +08:00
jingyaogong 7eae14f3ce [feat] remove empty_cache 2025-12-27 07:14:36 +08:00
jingyaogong 11b962da06 [feat] explicit left padding 2025-12-23 18:59:48 +08:00
jingyaogong fe24501602 [feat] adjust seq length 2025-12-14 20:41:58 +08:00
jingyaogong 5129f0e2a2 [fix] dtype & lr 2025-12-09 13:01:38 +08:00
dyhuachi bf3878ace8
[fix] Refactor get_lr function to include min_lr calculation
这里的退火算法会让参数里的lr的起始值变成原来lr的1.1倍,作出如下修改
2025-12-06 17:09:51 +08:00
jingyaogong 5e1447b913 [fix] cuda memory #559 2025-12-01 16:17:43 +08:00
jingyaogong 6b86ea399a [feat] release memory 2025-11-27 19:39:49 +08:00
jingyaogong d7f4f4eab8 [fix] ppo mask 2025-11-19 23:39:02 +08:00
jingyaogong 9c98cabc9a [fix] prompt length calculate 2025-11-15 18:25:37 +08:00
jingyaogong 509d8dacf1 [feat] clear cache 2025-11-06 13:12:28 +08:00
jingyaogong 0323815729 [feat] update import 2025-10-31 23:45:55 +08:00
jingyaogong bf123b585d [feat] add args 2025-10-30 10:05:12 +08:00
jingyaogong 1713c24114 [fix] model device 2025-10-29 10:36:28 +08:00
jingyaogong acd5925193 [feat] update trainer 2025-10-29 00:52:37 +08:00
jingyaogong 8f7e07b8ef [feat] update trainer 2025-10-28 23:30:10 +08:00
jingyaogong e8484874f5 [feat] pause-training 2025-10-26 18:49:52 +08:00
jingyaogong a82526da11 [feat] shuffle data 2025-10-23 20:13:28 +08:00
jingyaogong 805744e60a [fix] loss-issues-430 2025-10-23 19:08:42 +08:00
jingyaogong 557bcc018d [fix] issue-431 2025-10-23 18:56:30 +08:00
jingyaogong 463044e92a [fix] sampler-ddp 2025-10-23 15:03:19 +08:00
jingyaogong fa7dff8291 [fix] graph-oom & ddp-pos_cis 2025-10-23 14:22:13 +08:00
jingyaogong 7d877db79b [feat] minimind-2510 2025-10-21 21:19:47 +08:00
jingyaogong caae54a89e fix bugs 2025-04-29 20:45:39 +08:00
jingyaogong 5ffde04b7c update lora 2025-04-27 15:45:06 +08:00
jingyaogong 29454c31af fix bugs 2025-04-27 09:56:49 +08:00
jingyaogong a62faf34bd 250426 2025-04-26 10:05:47 +08:00