Hugging Face's logo

Epiculous
/
NeverSleep-Llama-3-Lumimaid-70B-v0.1-alt-4-Bit-AWQ

Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
4-bit precision
awq
Model card Files Community
Edit model card
README.md exists but content is empty. Use the Edit model card button to edit it.
Downloads last month
32
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference API
Text Generation
Examples
Input a message to start chatting with Epiculous/NeverSleep-Llama-3-Lumimaid-70B-v0.1-alt-4-Bit-AWQ.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.