Hugging Face's logo

bdambrosio
/
llama3-70B-Instruct-8.0bpw-h8-exl2

Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
8-bit precision
exl2
Model card Files Community
Edit model card

8 bit exl2 of llama3-70B-Instruct, for those who want the best exl2 can provide!

Downloads last month
2
Inference API
Text Generation
Examples
Input a message to start chatting with bdambrosio/llama3-70B-Instruct-8.0bpw-h8-exl2.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.