YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Setup
This is for the gcp vm. Mine came installed with python3.7 and cuda 11.3
Create a venv
python3 -m venv .venvsource .venv/bin/activate
You may have to install python3-venv to the machine.
Install
pip install -r requirements.txt
pip uninstall -r uninstall.txt
I had to uninstall some cuda stuff that torch installed to make this work.
References
https://github.com/tloen/alpaca-lora https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama https://huggingface.co/docs/transformers/index https://github.com/salesforce/WikiSQL https://github.com/huggingface/peft
https://arxiv.org/pdf/1910.13461.pdf https://arxiv.org/pdf/1808.06226.pdf
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.