ByteForge
/

Llama-3-8B-Text2SQL_Instruct-ct2-int8_float16

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Sagar Krishna commited on 18 days ago

Commit

7b27a65

•

1 Parent(s): 0505e9b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -319,7 +319,7 @@ More detailed information about the `generate_batch` methon can be found at [CTr
 import ctranslate2
 import transformers
-model_id = "avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16"
 model = ctranslate2.Generator(model_id, device="auto", compute_type="int8_float16")
 tokenizer = transformers.AutoTokenizer.from_pretrained(model_id)

 import ctranslate2
 import transformers
+model_id = "SagarKrishna/Llama-3-8B-Text2SQL_Instruct-ct2-int8_float16"
 model = ctranslate2.Generator(model_id, device="auto", compute_type="int8_float16")
 tokenizer = transformers.AutoTokenizer.from_pretrained(model_id)