Commit Graph

381 Commits (7988bc81a3f22a8534c0abd972a5b5abed550469)

Author SHA1 Message Date
gongjy 3a034a47c8 update readme 2024-10-10 22:13:10 +08:00
gongjy 5dbd6174b3 update readme 2024-10-09 09:12:55 +08:00
gongjy 4542ecf858 update readme 2024-10-09 00:03:07 +08:00
gongjy 772834148e update readme 2024-10-08 23:40:29 +08:00
gongjy 000b0a496b update readme 2024-10-08 23:16:29 +08:00
gongjy 5929d0f8b1 update readme 2024-10-07 18:42:53 +08:00
gongjy e4b8789d8c update readme 2024-10-05 22:59:00 +08:00
gongjy eb875da306 update readme 2024-10-05 00:35:54 +08:00
gongjy 1b864453fa update requirements.txt 2024-10-03 14:45:58 +08:00
gongjy a87f628400 update model (fix loss bug) 2024-09-29 16:58:48 +08:00
gongjy 4ef9c41563 fix deepspeed local_rank bug 2024-09-27 23:25:56 +08:00
gongjy 2981d3ea86 Update data preprocessing methods 2024-09-27 22:34:30 +08:00
gongjy 75753ea765 Update data preprocessing methods 2024-09-27 17:19:03 +08:00
gongjy 1cc73836d4 update readme info 2024-09-27 16:38:18 +08:00
gongjy a8ae342775 Update data preprocessing methods 2024-09-27 16:19:30 +08:00
gongjy d57037624b update batchsize 2024-09-25 12:35:29 +08:00
gongjy 89d260145f fix dtype bug 2024-09-25 10:07:30 +08:00
jingyaogong 13105cfa0c
Merge pull request #44 from iomgaa-ycz/wandb
修复wandb bug & 添加了argparse
2024-09-24 14:10:05 +08:00
jingyaogong 5dd4e15aa2
Merge branch 'master' into wandb 2024-09-24 14:09:54 +08:00
Yu Chengzhang d7a056a545 更新了ReadMe 2024-09-24 12:45:21 +08:00
Yu Chengzhang 51dcf51c5d 添加了argparse,方便命令行输入参数 2024-09-24 12:41:58 +08:00
Yu Chengzhang ef9a592d14 修复了wandb的bug,避免了多次产生项目 2024-09-24 11:43:30 +08:00
gongjy 7947fa17fb update wandb monitor 2024-09-23 22:16:21 +08:00
gongjy 235b6c6fd3 update wandb monitor 2024-09-23 22:14:52 +08:00
jingyaogong 15f8242ba7
Merge pull request #43 from iomgaa-ycz/wandb
use wandb to monitor training process
2024-09-23 21:54:48 +08:00
Yu Chengzhang 06a66d88c9 添加了wandb 2024-09-23 20:11:45 +08:00
gongjy b4359b3335 fix data_process bug 2024-09-23 20:11:19 +08:00
jingyaogong 5f8279f661
Merge pull request #42 from iomgaa-ycz/wandb
修复data_process.py文件追加的bug
2024-09-23 20:08:13 +08:00
Yu Chengzhang 0fa4d17d26 更新了忽视列表 2024-09-23 18:36:04 +08:00
Yu Chengzhang 6fb569abd8 修复了process_seq_monkey写入错误的bug 2024-09-23 18:34:58 +08:00
gongjy bf64ffb056 update data_process 2024-09-22 21:17:05 +08:00
gongjy 8ff2ccae4c update readme 2024-09-22 14:49:05 +08:00
gongjy d41b39c88c update readme 2024-09-22 14:45:37 +08:00
gongjy cbdea6bd9f update readme 2024-09-21 23:11:02 +08:00
gongjy 7115a98453 update data_process Chunk_size Read 2024-09-21 22:57:22 +08:00
gongjy 6759da45c1 update model mask 2024-09-21 20:00:25 +08:00
gongjy 02297df3c1 Efficient implementation of Inference KV cache 2024-09-21 00:01:05 +08:00
gongjy 0cd7d4b2c2 update readme 2024-09-20 21:21:25 +08:00
gongjy b969382f0a update readme 2024-09-20 21:19:59 +08:00
gongjy 6c1118ab86 update readme 2024-09-20 21:15:55 +08:00
gongjy 19523a121f update readme 2024-09-20 21:15:14 +08:00
gongjy 1c493e8c2a update readme 2024-09-20 20:33:46 +08:00
gongjy 9093519c37 Updated some explanations 2024-09-20 17:07:51 +08:00
gongjy 39423c6a14 Updated some explanations 2024-09-20 17:05:50 +08:00
gongjy ee218402cd update some explain of the code 2024-09-20 17:04:16 +08:00
jingyaogong b4170e3766
Merge pull request #34 from chuanzhubin/master
对主要代码添加逐行注释,方便学习者快速理解
2024-09-20 16:51:32 +08:00
jingyaogong 95b1ee8175
Merge branch 'master' into master 2024-09-20 16:51:03 +08:00
gongjy c81c17dab7 update others 2024-09-19 09:35:02 +08:00
gongjy 48ea6a4cbf update readme 2024-09-19 09:32:31 +08:00
gongjy c28664dac8 update minimind-v1-moe 2024-09-18 23:51:56 +08:00