| # Setup | |
| This is for the gcp vm. Mine came installed with python3.7 and cuda 11.3 | |
| ### Create a venv | |
| `python3 -m venv .venv` | |
| `source .venv/bin/activate` | |
| You may have to install python3-venv to the machine. | |
| ### Install | |
| ``` | |
| pip install -r requirements.txt | |
| pip uninstall -r uninstall.txt | |
| ``` | |
| I had to uninstall some cuda stuff that torch installed to make this work. | |
| # References | |
| https://github.com/tloen/alpaca-lora | |
| https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama | |
| https://huggingface.co/docs/transformers/index | |
| https://github.com/salesforce/WikiSQL | |
| https://github.com/huggingface/peft | |
| https://arxiv.org/pdf/1910.13461.pdf | |
| https://arxiv.org/pdf/1808.06226.pdf | |