disi-unibo-nlp
/

pmc-llama-13b-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

alecocc commited on Feb 27

Commit

9faa338

•

1 Parent(s): 275d684

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -20,8 +20,6 @@ Example of usage with vLLM library:
 ```python
 from vllm import LLM, SamplingParams
-tokenizer = AutoTokenizer.from_pretrained('axiong/PMC_LLaMA_13B')
 prompt_input = (
     'Below is an instruction that describes a task, paired with an input that provides further context.'
     'Write a response that appropriately completes the request.\n\n'

 ```python
 from vllm import LLM, SamplingParams
 prompt_input = (
     'Below is an instruction that describes a task, paired with an input that provides further context.'
     'Write a response that appropriately completes the request.\n\n'