d97e47c408
day01: 学习笔记 + 调试配置 + batch_size 默认值调整
...
- learning/day01/04_qa_notes.md: 第一天实操问答笔记（环境搭建、虚拟环境、
数据流与打点、数据清洗流水线、nvidia-smi 解读、batch/LR 缩放）
- .vscode/launch.json: VSCode 调试配置（train_pretrain + 当前文件）
- train_pretrain.py: batch_size 默认值 32 -> 128
- .gitignore: 忽略 checkpoints/ 和 dataset/*.jsonl 大文件
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-02 00:51:12 -04:00
b23a05868d
Add Day 1 learning notes and model Chinese comments
...
- learning/day01: prereading, deep dive, and exam notes
- model_minimind.py: added comprehensive Chinese comments for study
- .gitignore: minor update
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-01 21:33:23 -04:00
3f1a7cc25b
[fix] ddp exit hang
2026-06-01 17:50:39 +08:00
4a68da72d5
[fix] lora dims
2026-05-31 13:38:51 +08:00
4497610ec0
[fix] issue#771
2026-05-19 17:40:03 +08:00
9da8e1ab18
[update] requirements
2026-05-16 18:08:37 +08:00
dddedc6881
[fix] repetition_penalty
2026-05-07 19:08:52 +08:00
802c15b2b4
[feat] reduce RL memory
2026-05-06 15:07:28 +08:00
e73a407f7a
Merge pull request #759 from TKiteRunner/fix/grpo-oom-reorder-rewards
...
fix: resolve CUDA OOM in train_grpo.py on GPUs with <=8GB VRAM
2026-05-06 15:00:17 +08:00
10776417aa
fix: resolve CUDA OOM in train_grpo.py on GPUs with <=8GB VRAM
2026-05-06 14:14:15 +08:00
5020dc9dd4
[update] readme
2026-05-06 13:41:46 +08:00
bdee223036
[fix] inference bug
2026-05-03 20:48:48 +08:00
06d882e4ef
[update] readme
2026-05-01 12:06:47 +08:00
da865af63d
[update] readme
2026-04-28 17:22:25 +08:00
773e451b11
[fix] bugs
2026-04-27 19:16:08 +08:00
6361510016
[fix] rollout bugs
2026-04-27 17:54:09 +08:00
d4c6bc5c7e
[update] readme
2026-04-27 10:59:41 +08:00
24896cd2c4
[update] readme
2026-04-24 20:16:06 +08:00
e2fc397176
[update] readme
2026-04-24 20:14:10 +08:00
693fb1ccf1
[update] readme
2026-04-21 14:34:46 +08:00
5416a44471
[fix] bugs
2026-04-21 13:03:34 +08:00
1718e9a44d
[fix] transformers-5.x
2026-04-19 23:48:54 +08:00
5704766352
[update] tie embedding
2026-04-19 21:57:28 +08:00
1ea113ea2c
[update] readme
2026-04-19 14:51:47 +08:00
487f78754d
[update] readme
2026-04-10 10:55:24 +08:00
e796b8028a
[fix] lora compile
2026-04-10 00:01:21 +08:00
b2488e6440
[update] readme
2026-04-09 19:00:41 +08:00
939dc8ff42
[update] readme
2026-04-09 18:54:17 +08:00
cadacabecb
[update] bench
2026-04-09 17:12:48 +08:00
5351424bf0
[fix] lora moe
2026-04-09 16:36:48 +08:00
aa3e6affa1
[update] add a comment
2026-04-09 15:09:58 +08:00
25a7edcd6f
[update] image
2026-04-04 14:54:13 +08:00
cacf1d4cd0
[update] readme
2026-04-04 11:25:21 +08:00
2ab6455d9d
[update] open causal
2026-04-02 15:28:58 +08:00
9348fde743
[update] readme
2026-04-02 15:28:29 +08:00
90cd275524
[update] readme
2026-04-01 14:00:21 +08:00
b7e0ae21d6
[update] default model
2026-03-31 13:40:16 +08:00
b1865f75c2
[update] random seed
2026-03-27 21:20:02 +08:00
6b0b0c5e2f
[update] fp16 inference
2026-03-27 16:29:46 +08:00
88e675dc2c
[update] image
2026-03-26 15:35:42 +08:00
b8b3d35257
[update] change default seq_len
2026-03-26 10:09:06 +08:00
101d7df2da
[update] minimind-3
2026-03-25 23:57:45 +08:00
83e52f6a27
Merge pull request #698 from readlnh/master
...
[fix] 修复训练脚本中 1-indexed step 与 0-indexed 逻辑混用的问题
2026-03-24 13:41:20 +08:00
cf4b49a348
[fix] align log/save last-step check and ETA with 1-indexed step
2026-03-24 02:01:40 +01:00
d25500d363
[fix] gradient accumulation step alignment
2026-03-24 01:45:04 +01:00
349e74ec7b
[update] empty_think_ratio
2026-02-06 19:15:21 +08:00
288e1ac02a
[update] empty_think_ratio
2026-02-06 01:36:02 +08:00
ccc190da05
[feat] data process
2026-02-06 01:17:57 +08:00
11a44340ba
[update] save interval
2026-01-30 20:30:50 +08:00
04616c41a5
[update] safe half
2026-01-30 20:29:31 +08:00
QiaohuiGao
jingyaogong
TKiteRunner
jingyaogong
jingyaogong
readlnh