disi-unibo-nlp
/

pmc-llama-13b-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

alecocc commited on Feb 23

Commit

d5f2846

•

1 Parent(s): 5ac00d7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -29,7 +29,7 @@ prompts = [
 sampling_params = SamplingParams(temperature=0.8)
-llm = LLM(model="axiong/PMC_LLaMA_13B", quantization="awq", dtype="half")
 outputs = llm.generate(prompts, sampling_params)

 sampling_params = SamplingParams(temperature=0.8)
+llm = LLM(model="disi-unibo-nlp/pmc-llama-13b-awq", quantization="awq", dtype="half")
 outputs = llm.generate(prompts, sampling_params)