File size: 690 Bytes
ce9f9a1
 
 
 
 
 
 
 
 
 
 
 
 
dd87728
 
 
 
8f8b1a3
2a75437
 
dd87728
 
 
 
 
 
ce9f9a1
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
# Setup
This is for the gcp vm.  Mine came installed with python3.7 and cuda 11.3
### Create a venv
`python3 -m venv .venv`  
`source .venv/bin/activate`
You may have to install python3-venv to the machine.
### Install 
```
pip install -r requirements.txt
pip uninstall -r uninstall.txt
```
I had to uninstall some cuda stuff that torch installed to make this work.

# References
https://github.com/tloen/alpaca-lora
https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama
https://huggingface.co/docs/transformers/index
https://github.com/salesforce/WikiSQL
https://github.com/huggingface/peft



https://arxiv.org/pdf/1910.13461.pdf
https://arxiv.org/pdf/1808.06226.pdf