Hugging Face's logo

Aitrepreneur
/
wizardLM-7B-GPTQ-4bit-128g

Text Generation
Transformers
llama
text-generation-inference
Inference Endpoints
Model card Files Community
5

Change use_cache to true

#3
by TheEnthusiast - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+19
-14
TheEnthusiast

This speeds up how quickly text is outputted by the model

Change use_cache to true00a351ac
TheEnthusiast changed pull request status to closed

Sign up or log in to comment