Hugging Face's logo

Tanvir1337
/
quantized-models

Text Generation
Transformers
GGUF
English
exl2
large language model
text-generation-inference
Inference Endpoints
conversational
Model card Files Community
Tanvir1337 commited on
Commit
c1423bd
β€’
1 Parent(s): e0791b6

Upload 4 files

Browse files
Files changed (4) hide show
  1. 8B/Llama3-8B-1.58-100B-tokens-TQ1_0-F16.gguf +3 -0
  2. 8B/Llama3-8B-1.58-100B-tokens-TQ1_0.gguf +3 -0
  3. 8B/Llama3-8B-1.58-100B-tokens-TQ2_0.gguf +3 -0
  4. 8B/llama3-8b-1.58bit-gguf-unsloth.F16.gguf +3 -0
8B/Llama3-8B-1.58-100B-tokens-TQ1_0-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28a00bf187438010b20907220da068d76cf77821e6c516e7547964def1838566
3
+ size 3582448384
8B/Llama3-8B-1.58-100B-tokens-TQ1_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83282fd9a6871536d773758d8c9b7d54f299122405a0f4a396e6bd60c581d337
3
+ size 2207544064
8B/Llama3-8B-1.58-100B-tokens-TQ2_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2565559c82a1d03ecd1101f536c5e99418d07e55a88bd5e391ed734f6b3989ac
3
+ size 2534699776
8B/llama3-8b-1.58bit-gguf-unsloth.F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4775985b40ceb600bb1fa23afcb1d60d107d3a37bce2f59e563d620660528ade
3
+ size 6018637728