Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,7 @@ The total size of the model is around 2.2B, which is suitable for embedded appli
|
|
12 |
```
|
13 |
git clone https://github.com/InternLM/xtuner
|
14 |
pip install -e ./xtuner[deepspeed]
|
|
|
15 |
git clone https://huggingface.co/StarCycle/llava-clip-internlm2-1_8b-pretrain-v1
|
16 |
cd ./llava-clip-internlm2-1_8b-pretrain-v1
|
17 |
```
|
@@ -71,9 +72,11 @@ def process(dataset,
|
|
71 |
use_varlen_attn=False,
|
72 |
input_ids_with_output=True,
|
73 |
with_image_token=False,
|
74 |
-
map_num_proc=32): # modify it to
|
75 |
```
|
76 |
|
|
|
|
|
77 |
## Data prepration
|
78 |
1. File structure
|
79 |
|
|
|
12 |
```
|
13 |
git clone https://github.com/InternLM/xtuner
|
14 |
pip install -e ./xtuner[deepspeed]
|
15 |
+
apt install git-lfs
|
16 |
git clone https://huggingface.co/StarCycle/llava-clip-internlm2-1_8b-pretrain-v1
|
17 |
cd ./llava-clip-internlm2-1_8b-pretrain-v1
|
18 |
```
|
|
|
72 |
use_varlen_attn=False,
|
73 |
input_ids_with_output=True,
|
74 |
with_image_token=False,
|
75 |
+
map_num_proc=32): # modify it to a smaller number, e.g., 4
|
76 |
```
|
77 |
|
78 |
+
6. If you fail to load the model, check whether you installed git-lfs and actually downloaded the model file.
|
79 |
+
|
80 |
## Data prepration
|
81 |
1. File structure
|
82 |
|