disi-unibo-nlp
/

pmc-llama-13b-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

alecocc commited on Feb 23

Commit

1a30347

•

1 Parent(s): d7a5687

Update README.md

Files changed (1) hide show

README.md +0 -3

README.md CHANGED Viewed

@@ -28,9 +28,6 @@ prompts = [
     "Tell me about Paracetamol",
 ]
-'''
 sampling_params = SamplingParams(temperature=0.8)
 llm = LLM(model="axiong/PMC_LLaMA_13B", quantization="awq", dtype="half")

     "Tell me about Paracetamol",
 ]
 sampling_params = SamplingParams(temperature=0.8)
 llm = LLM(model="axiong/PMC_LLaMA_13B", quantization="awq", dtype="half")