b23a05868d
Add Day 1 learning notes and model Chinese comments
...
- learning/day01: prereading, deep dive, and exam notes
- model_minimind.py: added comprehensive Chinese comments for study
- .gitignore: minor update
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-01 21:33:23 -04:00
dddedc6881
[fix] repetition_penalty
2026-05-07 19:08:52 +08:00
1718e9a44d
[fix] transformers-5.x
2026-04-19 23:48:54 +08:00
5704766352
[update] tie embedding
2026-04-19 21:57:28 +08:00
2ab6455d9d
[update] open causal
2026-04-02 15:28:58 +08:00
101d7df2da
[update] minimind-3
2026-03-25 23:57:45 +08:00
c090b69c4d
[update] align loss
2026-01-15 00:56:32 +08:00
1279a61681
[update] prompt prefill
2026-01-13 17:46:54 +08:00
9d898576ac
[update] aux loss
2026-01-01 22:41:46 +08:00
c65335b56f
[fix] experts unused
2025-12-31 21:47:04 +08:00
5129f0e2a2
[fix] dtype & lr
2025-12-09 13:01:38 +08:00
ecd1ae1563
[fix] reduce aux_loss_alpha
2025-12-05 23:08:29 +08:00
151fdf7e76
[feat] update yarn
2025-12-01 16:15:05 +08:00
6b86ea399a
[feat] release memory
2025-11-27 19:39:49 +08:00
f5374dc87f
[fix] model attn_mask
2025-11-19 22:26:53 +08:00
a044578d73
[fix] update model
2025-11-18 13:07:20 +08:00
7d02ce673c
fix: attn_forwad when is_causal=True assert attn_mask is None
2025-11-18 03:17:17 +00:00
4e35fb9da8
[fix] update model
2025-10-17 00:09:32 +08:00
29454c31af
fix bugs
2025-04-27 09:56:49 +08:00
a62faf34bd
250426
2025-04-26 10:05:47 +08:00
QiaohuiGao
jingyaogong
jingyaogong
yuyu5333