github
/
minimind-v
mirror of https://github.com/jingyaogong/minimind-v.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

update readme

pull/19/head
gongjy 2024-10-07 17:42:36 +08:00
parent 3cba851a48
commit d618ffe3b7
2 changed files with 4 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -149,12 +149,12 @@ CPU: Intel(R) Core(TM) i9-10980XE CPU @ 3.00GHz
* 2.下载 `clip-vit-base-patch32` 模型，放到 `./model/clip_model` 目录下：
```bash
cd ./model/clip_model & git clone https://hf-mirror.com/openai/clip-vit-base-patch32
cd ./model/clip_model & git clone https://huggingface.co/openai/clip-vit-base-patch32
```
* 3.如果需要自己训练
* 3.1 下载数据集 ([百度网盘](https://pan.baidu.com/s/1Nz36OBBvVBGEx-PwIb7ofg?pwd=6666) or [HuggingFace](https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset))文件到`./dataset`
* 3.1 下载数据集 ([百度网盘](https://pan.baidu.com/s/1Nz36OBBvVBGEx-PwIb7ofg?pwd=6666) or [HuggingFace](https://huggingface.co/datasets/jingyaogong/minimind-v_dataset))文件到`./dataset`
目录下，并解压`pretrain_images.zip` 和 `sft_images.zip`
* 3.2 在`./model/LMConfig.py` 中调整model的参数配置
> 这里仅需调整dim和n_layers参数，分别是`(512+8)`或`(768+16)`，对应于`minimind-v-v1-small`和`minimind-v-v1`

4
README_en.md
View File

@ -147,12 +147,12 @@ Environment: python 3.9 + Torch 2.1.2 + DDP single-machine multi-GPU training
* 2.Download the `clip-vit-base-patch32` model and place it in the `./model/clip_model` directory:
```bash
cd ./model/clip_model & git clone https://hf-mirror.com/openai/clip-vit-base-patch32
cd ./model/clip_model & git clone https://huggingface.co/openai/clip-vit-base-patch32
```
* 3.If you want to train it yourself
* 3.1 Download all contents of the dataset ([Baidu Netdisk](https://pan.baidu.com/s/1Nz36OBBvVBGEx-PwIb7ofg?pwd=6666) or [HuggingFace](https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset)) to the `./dataset` directory, and unzip `pretrain_images.zip` and `sft_images.zip`
* 3.1 Download all contents of the dataset ([Baidu Netdisk](https://pan.baidu.com/s/1Nz36OBBvVBGEx-PwIb7ofg?pwd=6666) or [HuggingFace](https://huggingface.co/datasets/jingyaogong/minimind-v_dataset)) to the `./dataset` directory, and unzip `pretrain_images.zip` and `sft_images.zip`
* 3.2 Adjust the model parameters in `./model/LMConfig.py`
> Only need to adjust the dim and n_layers parameters, which are `(512+8)` or `(768+16)`, corresponding to `minimind-v-v1-small` and `minimind-v-v1`
* 3.3 Download the [pre-trained weight file](https://pan.baidu.com/s/1LE1SPoPYGS7VNtT1tpf7DA?pwd=6666) of the MiniMind language model and place it in the `./out/` directory, named `*_llm.pth`