Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Model Tree
Reset
meta-llama/Llama-3.1-70B
Adapters
Finetunes
Quantizations
Merges
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
4-bit precision
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
29
Full-text search
Edit filters
Sort: Trending
Active filters:
meta-llama/Llama-3.1-70B
Clear all
hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16
Text Generation
•
Updated
Aug 8
•
619
•
2
mradermacher/Meta-Llama-3.1-70B-GGUF
Updated
Aug 2
•
513
mradermacher/Meta-Llama-3.1-70B-i1-GGUF
Updated
Aug 2
•
1.22k
•
1
neuralmagic/Meta-Llama-3.1-70B-FP8
Text Generation
•
Updated
11 days ago
•
497
NousResearch/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 23
•
2.02k
•
32
LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2
Updated
Aug 15
•
1
LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2
Updated
Aug 16
•
11
LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2
Updated
Aug 16
•
6
LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2
Updated
Aug 16
•
8
LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2
Updated
Aug 16
•
6
LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2
Updated
Aug 16
•
4
LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2
Updated
Aug 16
LoneStriker/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 16
•
115
•
2
XelotX/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 17
•
63
Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2
Updated
Aug 18
•
6
bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2
Updated
Aug 22
•
3
bullerwins/Hermes-3-Llama-3.1-70B-exl2_4.0bpw
Updated
Aug 24
bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw
Updated
Aug 24
•
1
bullerwins/Hermes-3-Llama-3.1-70B-exl2_6.0bpw
Updated
Aug 24
•
5
Niansuh/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 25
•
61
bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2
Updated
Aug 26
•
2
bigstorm/Hermes-3-Llama-3.1-70B-8.0bpw-8hb-exl2
Updated
Aug 26
•
8
ArtyLLaMa/LLaMa3.1-Instruct-70b-GGUF
Text Generation
•
Updated
Aug 29
•
137
•
1
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit
Text Generation
•
Updated
Sep 4
•
207
Ffftdtd5dtft/Meta-Llama-3.1-70B-Q2_K-GGUF
Text Generation
•
Updated
Sep 3
•
124
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
Text Generation
•
Updated
Sep 9
•
49
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
•
Updated
Sep 14
•
223
•
16
mav23/Llama-3.1-70B-Instruct-GGUF
Text Generation
•
Updated
17 days ago
•
475
medmekk/Llama-3.1-70B-torchao-int8_weight_only
Updated
12 days ago
•
43