gongjy
|
5929d0f8b1
|
update readme
|
2024-10-07 18:42:53 +08:00 |
|
gongjy
|
e4b8789d8c
|
update readme
|
2024-10-05 22:59:00 +08:00 |
|
gongjy
|
eb875da306
|
update readme
|
2024-10-05 00:35:54 +08:00 |
|
gongjy
|
1b864453fa
|
update requirements.txt
|
2024-10-03 14:45:58 +08:00 |
|
gongjy
|
a87f628400
|
update model (fix loss bug)
|
2024-09-29 16:58:48 +08:00 |
|
gongjy
|
4ef9c41563
|
fix deepspeed local_rank bug
|
2024-09-27 23:25:56 +08:00 |
|
gongjy
|
2981d3ea86
|
Update data preprocessing methods
|
2024-09-27 22:34:30 +08:00 |
|
gongjy
|
75753ea765
|
Update data preprocessing methods
|
2024-09-27 17:19:03 +08:00 |
|
gongjy
|
1cc73836d4
|
update readme info
|
2024-09-27 16:38:18 +08:00 |
|
gongjy
|
a8ae342775
|
Update data preprocessing methods
|
2024-09-27 16:19:30 +08:00 |
|
gongjy
|
d57037624b
|
update batchsize
|
2024-09-25 12:35:29 +08:00 |
|
gongjy
|
89d260145f
|
fix dtype bug
|
2024-09-25 10:07:30 +08:00 |
jingyaogong
|
13105cfa0c
|
Merge pull request #44 from iomgaa-ycz/wandb
修复wandb bug & 添加了argparse
|
2024-09-24 14:10:05 +08:00 |
|
jingyaogong
|
5dd4e15aa2
|
Merge branch 'master' into wandb
|
2024-09-24 14:09:54 +08:00 |
Yu Chengzhang
|
d7a056a545
|
更新了ReadMe
|
2024-09-24 12:45:21 +08:00 |
|
Yu Chengzhang
|
51dcf51c5d
|
添加了argparse，方便命令行输入参数
|
2024-09-24 12:41:58 +08:00 |
|
Yu Chengzhang
|
ef9a592d14
|
修复了wandb的bug，避免了多次产生项目
|
2024-09-24 11:43:30 +08:00 |
|
gongjy
|
7947fa17fb
|
update wandb monitor
|
2024-09-23 22:16:21 +08:00 |
|
gongjy
|
235b6c6fd3
|
update wandb monitor
|
2024-09-23 22:14:52 +08:00 |
|
jingyaogong
|
15f8242ba7
|
Merge pull request #43 from iomgaa-ycz/wandb
use wandb to monitor training process
|
2024-09-23 21:54:48 +08:00 |
|
Yu Chengzhang
|
06a66d88c9
|
添加了wandb
|
2024-09-23 20:11:45 +08:00 |
|
gongjy
|
b4359b3335
|
fix data_process bug
|
2024-09-23 20:11:19 +08:00 |
|
jingyaogong
|
5f8279f661
|
Merge pull request #42 from iomgaa-ycz/wandb
修复data_process.py文件追加的bug
|
2024-09-23 20:08:13 +08:00 |
|
Yu Chengzhang
|
0fa4d17d26
|
更新了忽视列表
|
2024-09-23 18:36:04 +08:00 |
|
Yu Chengzhang
|
6fb569abd8
|
修复了process_seq_monkey写入错误的bug
|
2024-09-23 18:34:58 +08:00 |
|
gongjy
|
bf64ffb056
|
update data_process
|
2024-09-22 21:17:05 +08:00 |
|
gongjy
|
8ff2ccae4c
|
update readme
|
2024-09-22 14:49:05 +08:00 |
|
gongjy
|
d41b39c88c
|
update readme
|
2024-09-22 14:45:37 +08:00 |
|
gongjy
|
cbdea6bd9f
|
update readme
|
2024-09-21 23:11:02 +08:00 |
|
gongjy
|
7115a98453
|
update data_process Chunk_size Read
|
2024-09-21 22:57:22 +08:00 |
|
gongjy
|
6759da45c1
|
update model mask
|
2024-09-21 20:00:25 +08:00 |
|
gongjy
|
02297df3c1
|
Efficient implementation of Inference KV cache
|
2024-09-21 00:01:05 +08:00 |
|
gongjy
|
0cd7d4b2c2
|
update readme
|
2024-09-20 21:21:25 +08:00 |
|
gongjy
|
b969382f0a
|
update readme
|
2024-09-20 21:19:59 +08:00 |
|
gongjy
|
6c1118ab86
|
update readme
|
2024-09-20 21:15:55 +08:00 |
|
gongjy
|
19523a121f
|
update readme
|
2024-09-20 21:15:14 +08:00 |
|
gongjy
|
1c493e8c2a
|
update readme
|
2024-09-20 20:33:46 +08:00 |
|
gongjy
|
9093519c37
|
Updated some explanations
|
2024-09-20 17:07:51 +08:00 |
|
gongjy
|
39423c6a14
|
Updated some explanations
|
2024-09-20 17:05:50 +08:00 |
|
gongjy
|
ee218402cd
|
update some explain of the code
|
2024-09-20 17:04:16 +08:00 |
|
jingyaogong
|
b4170e3766
|
Merge pull request #34 from chuanzhubin/master
对主要代码添加逐行注释，方便学习者快速理解
|
2024-09-20 16:51:32 +08:00 |
|
jingyaogong
|
95b1ee8175
|
Merge branch 'master' into master
|
2024-09-20 16:51:03 +08:00 |
|
gongjy
|
c81c17dab7
|
update others
|
2024-09-19 09:35:02 +08:00 |
|
gongjy
|
48ea6a4cbf
|
update readme
|
2024-09-19 09:32:31 +08:00 |
|
gongjy
|
c28664dac8
|
update minimind-v1-moe
|
2024-09-18 23:51:56 +08:00 |
Ben
|
2dceaf4a92
|
添加注释，方便学习者快速理解
|
2024-09-18 21:53:39 +08:00 |
|
gongjy
|
61cb61a46a
|
update minimind-v1-moe
|
2024-09-17 11:33:31 +08:00 |
|
gongjy
|
c404941677
|
add accumulation_grad for pretrain
|
2024-09-16 20:58:46 +08:00 |
|
gongjy
|
8c18b324d0
|
update model
|
2024-09-16 16:59:52 +08:00 |
|
gongjy
|
e4ad822c40
|
update model
|
2024-09-16 15:29:57 +08:00 |