gongjy
|
acea505af0
|
update readme
|
2024-10-05 00:35:54 +08:00 |
|
gongjy
|
571fec6fdb
|
update requirements.txt
|
2024-10-03 14:45:58 +08:00 |
|
gongjy
|
5e67759d1a
|
update model (fix loss bug)
|
2024-09-29 16:58:48 +08:00 |
|
gongjy
|
1119025ac5
|
fix deepspeed local_rank bug
|
2024-09-27 23:25:56 +08:00 |
|
gongjy
|
43a7652134
|
Update data preprocessing methods
|
2024-09-27 22:34:30 +08:00 |
|
gongjy
|
682003cec6
|
Update data preprocessing methods
|
2024-09-27 17:19:03 +08:00 |
|
gongjy
|
a80e8e5f52
|
update readme info
|
2024-09-27 16:38:18 +08:00 |
|
gongjy
|
f351a61c8a
|
Update data preprocessing methods
|
2024-09-27 16:19:30 +08:00 |
|
gongjy
|
89b91ceaa0
|
update batchsize
|
2024-09-25 12:35:29 +08:00 |
|
gongjy
|
fc1400909a
|
fix dtype bug
|
2024-09-25 10:07:30 +08:00 |
jingyaogong
|
a0081c1931
|
Merge pull request #44 from iomgaa-ycz/wandb
修复wandb bug & 添加了argparse
|
2024-09-24 14:10:05 +08:00 |
|
jingyaogong
|
53379b9912
|
Merge branch 'master' into wandb
|
2024-09-24 14:09:54 +08:00 |
Yu Chengzhang
|
b43de06a70
|
更新了ReadMe
|
2024-09-24 12:45:21 +08:00 |
|
Yu Chengzhang
|
adbfdad1c1
|
添加了argparse，方便命令行输入参数
|
2024-09-24 12:41:58 +08:00 |
|
Yu Chengzhang
|
9172ec2f15
|
修复了wandb的bug，避免了多次产生项目
|
2024-09-24 11:43:30 +08:00 |
|
gongjy
|
f24f8bdc63
|
update wandb monitor
|
2024-09-23 22:16:21 +08:00 |
|
gongjy
|
dc7d1066e8
|
update wandb monitor
|
2024-09-23 22:14:52 +08:00 |
|
jingyaogong
|
e63ef387ad
|
Merge pull request #43 from iomgaa-ycz/wandb
use wandb to monitor training process
|
2024-09-23 21:54:48 +08:00 |
|
Yu Chengzhang
|
4895d77540
|
添加了wandb
|
2024-09-23 20:11:45 +08:00 |
|
gongjy
|
4b8df4a7e0
|
fix data_process bug
|
2024-09-23 20:11:19 +08:00 |
|
jingyaogong
|
130293a11f
|
Merge pull request #42 from iomgaa-ycz/wandb
修复data_process.py文件追加的bug
|
2024-09-23 20:08:13 +08:00 |
|
Yu Chengzhang
|
9291c7c8e9
|
更新了忽视列表
|
2024-09-23 18:36:04 +08:00 |
|
Yu Chengzhang
|
19a2428b60
|
修复了process_seq_monkey写入错误的bug
|
2024-09-23 18:34:58 +08:00 |
|
gongjy
|
44813d5f85
|
update data_process
|
2024-09-22 21:17:05 +08:00 |
|
gongjy
|
77a0528bbf
|
update readme
|
2024-09-22 14:49:05 +08:00 |
|
gongjy
|
58999b591e
|
update readme
|
2024-09-22 14:45:37 +08:00 |
|
gongjy
|
589a22f451
|
update readme
|
2024-09-21 23:11:02 +08:00 |
|
gongjy
|
8f0fd7affc
|
update data_process Chunk_size Read
|
2024-09-21 22:57:22 +08:00 |
|
gongjy
|
ef45699989
|
update model mask
|
2024-09-21 20:00:25 +08:00 |
|
gongjy
|
e892df833b
|
Efficient implementation of Inference KV cache
|
2024-09-21 00:01:05 +08:00 |
|
gongjy
|
2d4163a98a
|
update readme
|
2024-09-20 21:21:25 +08:00 |
|
gongjy
|
f4645e2997
|
update readme
|
2024-09-20 21:19:59 +08:00 |
|
gongjy
|
1553babe95
|
update readme
|
2024-09-20 21:15:55 +08:00 |
|
gongjy
|
2b92981237
|
update readme
|
2024-09-20 21:15:14 +08:00 |
|
gongjy
|
89a3d7124f
|
update readme
|
2024-09-20 20:33:46 +08:00 |
|
gongjy
|
b38f16b436
|
Updated some explanations
|
2024-09-20 17:07:51 +08:00 |
|
gongjy
|
aabe6566bd
|
Updated some explanations
|
2024-09-20 17:05:50 +08:00 |
|
gongjy
|
beca801dc2
|
update some explain of the code
|
2024-09-20 17:04:16 +08:00 |
|
jingyaogong
|
e6ce2e965a
|
Merge pull request #34 from chuanzhubin/master
对主要代码添加逐行注释，方便学习者快速理解
|
2024-09-20 16:51:32 +08:00 |
|
jingyaogong
|
4c1ec2d02c
|
Merge branch 'master' into master
|
2024-09-20 16:51:03 +08:00 |
|
gongjy
|
f7bd4cf9f8
|
update others
|
2024-09-19 09:35:02 +08:00 |
|
gongjy
|
354e018542
|
update readme
|
2024-09-19 09:32:31 +08:00 |
|
gongjy
|
519268ea3b
|
update minimind-v1-moe
|
2024-09-18 23:51:56 +08:00 |
Ben
|
39e07cc79b
|
添加注释，方便学习者快速理解
|
2024-09-18 21:53:39 +08:00 |
|
gongjy
|
bdf4be2add
|
update minimind-v1-moe
|
2024-09-17 11:33:31 +08:00 |
|
gongjy
|
fe8bf3b302
|
add accumulation_grad for pretrain
|
2024-09-16 20:58:46 +08:00 |
|
gongjy
|
955fcecbeb
|
update model
|
2024-09-16 16:59:52 +08:00 |
|
gongjy
|
6d688a01f7
|
update model
|
2024-09-16 15:29:57 +08:00 |
|
gongjy
|
903de424ce
|
update readme
|
2024-09-16 09:31:44 +08:00 |
|
gongjy
|
d276c3ddea
|
update readme
|
2024-09-16 09:29:40 +08:00 |