github
/
minimind
mirror of https://github.com/jingyaogong/minimind.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
215 Commits
2 Branches
2 Tags
417 MiB
Commit Graph

215 Commits (ccdf6c576fecb90eeab5d0e351f3738d6e82a6e6)

Author SHA1 Message Date
Gouryella ccdf6c576f Improve training performance with torch.compile and torch.amp 
- Update AMP usage from `torch.cuda.amp` to `torch.amp` for broader device compatibility.
- Add `torch.compile` to models in various training scripts (SFT, LoRA, DPO, Distillation, Pretrain, Distill Reason) to leverage potential performance gains.
- Implement a custom `load_state_dict` in `MiniMindForCausalLM` to handle state dict keys potentially modified by `torch.compile`.
 2025-05-21 12:16:02 +08:00
jingyaogong 561979c7e3 update torch version 2025-04-30 16:47:26 +08:00
jingyaogong caae54a89e fix bugs 2025-04-29 20:45:39 +08:00
jingyaogong 5ffde04b7c update lora 2025-04-27 15:45:06 +08:00
jingyaogong 2e118e9d3d update convert script 2025-04-27 15:44:40 +08:00
jingyaogong 29454c31af fix bugs 2025-04-27 09:56:49 +08:00
jingyaogong 765c79c7a2 update readme 2025-04-26 10:37:46 +08:00
jingyaogong 00d145c481 update readme 2025-04-26 10:21:34 +08:00
jingyaogong 274483cb1b 250426 2025-04-26 10:07:55 +08:00
jingyaogong a62faf34bd 250426 2025-04-26 10:05:47 +08:00
jingyaogong 7da201a944 update chat-openai-api 2025-04-18 12:43:57 +08:00
jingyaogong d9453ed9a3 update moe note 2025-04-09 17:38:31 +08:00
jingyaogong d503093ec4 update eval 2025-04-09 16:56:57 +08:00
jingyaogong 4a758564e4 fix top_p float bug 2025-04-09 16:52:20 +08:00
jingyaogong 4a7c1c49e8 update rlaif 2025-04-05 16:06:08 +08:00
jingyaogong 9e67798397 update generate 2025-04-05 15:53:55 +08:00
jingyaogong 399d526fbd add hidden state 2025-04-05 14:39:56 +08:00
jingyaogong 885661f47d update inference 2025-04-05 12:04:38 +08:00
jingyaogong ed01c5d84a update inference 2025-04-05 12:03:04 +08:00
jingyaogong 7fcc46b39a update seed set 2025-04-04 11:39:41 +08:00
jingyaogong 08e9a22a25 update web_demo 2025-04-04 11:25:40 +08:00
jingyaogong 278ec760a1 update dpo_loss 2025-04-01 17:32:50 +08:00
jingyaogong 4f95e23a98 update structure image 2025-04-01 16:15:26 +08:00
jingyaogong edc8d26189 update structure image 2025-04-01 16:11:54 +08:00
jingyaogong bf81fd5f5e rmsnorm float convert 2025-04-01 16:03:44 +08:00
jingyaogong e369b33265 fix chat mask bug 2025-04-01 13:44:55 +08:00
jingyaogong 258507ff89 delete __pycache__ 2025-04-01 11:51:54 +08:00
gongjy 04b56ea86c update readme 2025-02-23 20:07:26 +08:00
gongjy e34d4e9371 update tokenizer load 2025-02-19 23:24:29 +08:00
gongjy 45c0d12049 update images 2025-02-19 22:59:42 +08:00
gongjy f475e4e407 update images 2025-02-19 22:54:57 +08:00
gongjy ef7dff9fd4 update structure figure 2025-02-18 23:35:16 +08:00
gongjy dcf5fcdb08 update structure figure 2025-02-18 23:24:51 +08:00
gongjy 844e79148c update generate args 2025-02-15 23:56:09 +08:00
gongjy 19b388cd87 update generate args 2025-02-15 23:55:10 +08:00
gongjy 5b65bc767e update cis init 2025-02-15 20:26:34 +08:00
gongjy c1a77f5c0f update web_demo 2025-02-14 19:38:55 +08:00
gongjy d519d2a233 update web_demo 2025-02-14 19:37:27 +08:00
gongjy e7ed05834b fix bug 2025-02-13 21:07:43 +08:00
gongjy b5d10d9a7d fix bugs 2025-02-13 20:56:14 +08:00
gongjy 416cc90b58 update ckp-path 2025-02-12 20:34:47 +08:00
gongjy bab480073e update lr 2025-02-11 23:53:48 +08:00
gongjy d2f5ef4355 update lr 2025-02-11 23:52:40 +08:00
gongjy fea5b0eafc update readme 2025-02-10 23:34:52 +08:00
gongjy 291c19dc5e update markdown 2025-02-10 23:22:53 +08:00
gongjy 6f383e29fb update markdown 2025-02-10 23:19:23 +08:00
gongjy 97886fef2e update readme 2025-02-10 22:25:35 +08:00
gongjy be9b434379 update readme 2025-02-10 22:22:35 +08:00
gongjy ddb7e666a3 update readme 2025-02-10 13:32:01 +08:00
gongjy 0c5104885a update readme 2025-02-10 13:30:55 +08:00