README.md

Setup

This is for the gcp vm. Mine came installed with python3.7 and cuda 11.3

Create a venv

python3 -m venv .venv
source .venv/bin/activate You may have to install python3-venv to the machine.

Install

pip install -r requirements.txt
pip uninstall -r uninstall.txt

I had to uninstall some cuda stuff that torch installed to make this work.

References

https://github.com/tloen/alpaca-lora https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama https://huggingface.co/docs/transformers/index https://github.com/salesforce/WikiSQL https://github.com/huggingface/peft

https://arxiv.org/pdf/1910.13461.pdf https://arxiv.org/pdf/1808.06226.pdf