github
/
minimind
mirror of https://github.com/jingyaogong/minimind.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
minimind/scripts
History
baihaochen bc3d137248 [feat] add MLA with decoupled RoPE (DeepSeek-V2 style) 
- Add model_minimind_mla.py with Q/KV low-rank compression and decoupled RoPE
- Add kv_norm on kv_latent, q_compress + q_up + q_rope_proj for Q path
- Cache format: (kv_latent, k_rope) tuple, 176 floats/tok/layer (4.4x compression)
- Add --use_mla flag to all training scripts and utils
- Add benchmark_gqa_vs_mla.py script
 		2026-05-12 18:38:47 +08:00
..
benchmark_gqa_vs_mla.py [feat] add MLA with decoupled RoPE (DeepSeek-V2 style) 2026-05-12 18:38:47 +08:00
chat_api.py [update] minimind-3 2026-03-25 23:57:45 +08:00
convert_model.py [feat] add MLA with decoupled RoPE (DeepSeek-V2 style) 2026-05-12 18:38:47 +08:00
eval_toolcall.py [feat] add MLA with decoupled RoPE (DeepSeek-V2 style) 2026-05-12 18:38:47 +08:00
serve_openai_api.py [feat] add MLA with decoupled RoPE (DeepSeek-V2 style) 2026-05-12 18:38:47 +08:00
web_demo.py [update] fp16 inference 2026-03-27 16:29:46 +08:00