minimind/model
Gouryella ccdf6c576f Improve training performance with torch.compile and torch.amp
- Update AMP usage from `torch.cuda.amp` to `torch.amp` for broader device compatibility.
- Add `torch.compile` to models in various training scripts (SFT, LoRA, DPO, Distillation, Pretrain, Distill Reason) to leverage potential performance gains.
- Implement a custom `load_state_dict` in `MiniMindForCausalLM` to handle state dict keys potentially modified by `torch.compile`.
2025-05-21 12:16:02 +08:00
..
__init__.py 250426 2025-04-26 10:05:47 +08:00
model_lora.py update lora 2025-04-27 15:45:06 +08:00
model_minimind.py Improve training performance with torch.compile and torch.amp 2025-05-21 12:16:02 +08:00
tokenizer.json 250426 2025-04-26 10:07:55 +08:00
tokenizer_config.json 250426 2025-04-26 10:07:55 +08:00