teelinsan commited on
Commit
8cda2e2
·
1 Parent(s): 2926ab9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: openrail
3
+ language:
4
+ - it
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - llama
8
+ - italian
9
+ - italiano
10
+ ---
11
+
12
+ # Camoscio: An Italian instruction-tuned LLaMA
13
+
14
+ ## Usage
15
+
16
+ Check the Github repo with code: https://github.com/teelinsan/camoscio
17
+
18
+ ```python
19
+ from peft import PeftModel
20
+ from transformers import LLaMATokenizer, LLaMAForCausalLM, GenerationConfig
21
+
22
+ tokenizer = LLaMATokenizer.from_pretrained("decapoda-research/llama-7b-hf")
23
+ model = LLaMAForCausalLM.from_pretrained(
24
+ "decapoda-research/llama-7b-hf",
25
+ load_in_8bit=True,
26
+ device_map="auto",
27
+ )
28
+ model = PeftModel.from_pretrained(model, "teelinsan/camoscio-7b-llama")
29
+ ```
30
+
31
+ [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/teelinsan/camoscio/blob/master/notebooks/camoscio-lora.ipynb)