[update] readme
parent
33db76fe10
commit
56ab6ebd13
|
|
@ -212,12 +212,12 @@ print(torch.cuda.is_available())
|
|||
|
||||
Pretrain数据:
|
||||
```bash
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_data.parquet
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_i2t.parquet
|
||||
```
|
||||
|
||||
SFT数据:
|
||||
```bash
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_data.parquet
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_i2t.parquet
|
||||
```
|
||||
|
||||
建议预留~2GB空间存放数据集,若无多余空间存放pretrain数据,可尝试跳过pretrain训练步骤直接进行sft训练。
|
||||
|
|
|
|||
|
|
@ -220,12 +220,12 @@ and place it under `./dataset`.
|
|||
|
||||
Pretrain data:
|
||||
```bash
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_data.parquet
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_i2t.parquet
|
||||
```
|
||||
|
||||
SFT data:
|
||||
```bash
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_data.parquet
|
||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_i2t.parquet
|
||||
```
|
||||
|
||||
Please reserve about ~2GB of space for the dataset. If there is insufficient space for pretrain data, you can try skipping the pretrain training step and proceed directly to SFT training.
|
||||
|
|
|
|||
Loading…
Reference in New Issue