Commit Graph

4 Commits (bae81a2ce95e971d7bb331e811efaa196e80dbc0)

Author SHA1 Message Date
Ltimbe bae81a2ce9 Add rSVD-based adaptive LoRA rank estimation 2025-12-16 19:36:14 +08:00
Ltimbe be979ec9e7
Modify LoRA application conditions in model_lora.py
原本的lora只作用于方阵上,也就是q_proj和o_proj。修改完会同时作用于qkvo
2025-12-05 21:13:42 +08:00
jingyaogong 5ffde04b7c update lora 2025-04-27 15:45:06 +08:00
gongjy 58e3af0359 add minimind2 2025-02-09 23:49:47 +08:00