Hugging Face's logo

bartowski
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
14
bartowski commited on
Commit
6f22263
•
1 Parent(s): 9a8dec5

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Meta-Llama-3.1-8B-Instruct-Q4_0_4_4.gguf +3 -0
  3. Meta-Llama-3.1-8B-Instruct-Q4_0_4_8.gguf +3 -0
  4. Meta-Llama-3.1-8B-Instruct-Q4_0_8_8.gguf +3 -0
.gitattributes CHANGED
@@ -55,3 +55,6 @@ Meta-Llama-3.1-8B-Instruct-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
55
  Meta-Llama-3.1-8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
56
  Meta-Llama-3.1-8B-Instruct-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
57
  Meta-Llama-3.1-8B-Instruct-f32.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
55
  Meta-Llama-3.1-8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
56
  Meta-Llama-3.1-8B-Instruct-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
57
  Meta-Llama-3.1-8B-Instruct-f32.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Meta-Llama-3.1-8B-Instruct-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Meta-Llama-3.1-8B-Instruct-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Meta-Llama-3.1-8B-Instruct-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-8B-Instruct-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89f6957664441a4dd927e8f72fc4accb5008fd310f4af35f8f4e9d25de3e307d
3
+ size 4661216672
Meta-Llama-3.1-8B-Instruct-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9384fb0c903c9a4e2533133a5ba9b3cf7ca8894d2496a1746978443c6eefa47
3
+ size 4661216672
Meta-Llama-3.1-8B-Instruct-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0efffa698e2c92958e4a4351519ab9b83609666a0fba819336158cdc9cf9cd5b
3
+ size 4661216672