[update] readme
parent
33db76fe10
commit
56ab6ebd13
|
|
@ -212,12 +212,12 @@ print(torch.cuda.is_available())
|
||||||
|
|
||||||
Pretrain数据:
|
Pretrain数据:
|
||||||
```bash
|
```bash
|
||||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_data.parquet
|
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_i2t.parquet
|
||||||
```
|
```
|
||||||
|
|
||||||
SFT数据:
|
SFT数据:
|
||||||
```bash
|
```bash
|
||||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_data.parquet
|
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_i2t.parquet
|
||||||
```
|
```
|
||||||
|
|
||||||
建议预留~2GB空间存放数据集,若无多余空间存放pretrain数据,可尝试跳过pretrain训练步骤直接进行sft训练。
|
建议预留~2GB空间存放数据集,若无多余空间存放pretrain数据,可尝试跳过pretrain训练步骤直接进行sft训练。
|
||||||
|
|
|
||||||
|
|
@ -220,12 +220,12 @@ and place it under `./dataset`.
|
||||||
|
|
||||||
Pretrain data:
|
Pretrain data:
|
||||||
```bash
|
```bash
|
||||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_data.parquet
|
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/pretrain_i2t.parquet
|
||||||
```
|
```
|
||||||
|
|
||||||
SFT data:
|
SFT data:
|
||||||
```bash
|
```bash
|
||||||
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_data.parquet
|
wget https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset/resolve/main/sft_i2t.parquet
|
||||||
```
|
```
|
||||||
|
|
||||||
Please reserve about ~2GB of space for the dataset. If there is insufficient space for pretrain data, you can try skipping the pretrain training step and proceed directly to SFT training.
|
Please reserve about ~2GB of space for the dataset. If there is insufficient space for pretrain data, you can try skipping the pretrain training step and proceed directly to SFT training.
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue