baihaochen
|
33233fed6e
|
feat: add SearchShortQA DeepSpeed pipeline
|
2026-06-02 00:59:46 +08:00 |
|
baihaochen
|
46dabcfc19
|
chore: remove unused import
|
2026-05-23 16:42:02 +08:00 |
|
baihaochen
|
907f31f357
|
chore: add deepspeed suffix to save_weight, update default data_path
|
2026-05-23 16:38:49 +08:00 |
|
baihaochen
|
4f5cdfe59a
|
fix: avoid double init_process_group in DeepSpeed pretrain
|
2026-05-23 16:21:57 +08:00 |
|
baihaochen
|
ed006a254f
|
[feat] add DeepSpeed pretrain (ZeRO-2, BF16, auto LR, gradient accumulation)
|
2026-05-22 00:27:06 +08:00 |