File size: 887 Bytes
12001a9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
## Customize paths

The project is setup to use specific paths to read the original weights and save checkpoints etc.

For all scripts, you can run

```shell
python script.py -h
```

to get a list of available options. For instance, here's how you would modify the checkpoint dir:

```shell
python scripts/convert_checkpoint.py --checkpoint_dir "data/checkpoints/foo"
```

Note that this change will need to be passed along to subsequent steps, for example:

```shell
python scripts/generate.py \
  --checkpoint_path "data/checkpoints/foo/7B/lit-llama.pth" \
  --tokenizer_path "data/checkpoints/foo/tokenizer.model"
```

and

```shell
python scripts/quantize.py \
  --checkpoint_path "data/checkpoints/foo/7B/lit-llama.pth" \
  --tokenizer_path "data/checkpoints/foo/tokenizer.model"
```

To avoid this, you can use symbolic links to create shortcuts and avoid passing different paths.