Hugging Face's logo

MaziyarPanahi
/
EXAONE-3.5-32B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
d38e555
•
1 Parent(s): 214fbcc

[WIP] Upload folder using huggingface_hub (multi-commit 046a26f7192be21f52f864788fb7231bd3ce59ffa1311cef4fb5fe115ee5ae56) (#1)

Browse files

- de3c79ed1d8c1e36bd4ded51decf76efae3e40923895a5d0d62f5687c72dfd1c (e9d9cf8778c208d1641cd2d8d5d14538e857d2d6)
- cca4701b0ad1eb2eb58e55347d71306d41fa8dd714e2a71cb2b4ef2d45684b0c (152b069a334e0b4bfc8f1208ac5edadd0857f0db)
- 2ae7965fb65de1b1d10edbc0eb849a88215fde5fbec050acd0cbbaf91ef40fef (b6d8e935b840b42fac1ed6780d8208a60316a1f3)
- 55038f68b54cdb04a10a1e9ef7beee353f0dfd56d87f0deaef4dd841232818d4 (53f9387a6ec626a8b13600e49a76156c2534c92f)
- 562f683072e5543e88ab68a8960200190abe2fa6038628b79b283e14e2f60e71 (e855982e62778883ac8d6e9418ac52a2b2fc9857)
- 5e1760959c6efb09aa25f5b41cfd62a1e2ef7778165274955819ddabcaf76f3f (1bb98c3608636ef7936d5c220c26ce3a06a8fa4b)
- 3cf81a9fb9f83f43b84ee32d4b9d27f93e0901691e72e7f3e1a5c17b5a11541e (13af350993898dc1e691f00ed7a9bb45e374a828)
- e8cf0e80d1ef44610d0d78e7f53cea84ecc5af963d74007cc4ca728f8da2b2fb (d3e0b07c798febdd4ae357030a41ee029de9b6a8)
- 44d3b6cdbff959a8be5aa78c5d12e897639892208494be2611c71e6340744634 (85709cbb656a4decd32a4a2d7680493dfcaac6de)
- 7df3b5dae633adc960a5cdaa3449857943d8b359cbcd02d15fd0bb0b3a92d145 (caad2b3679d0d8b8ab66879edb22f5fed81f4780)

Files changed (11) hide show
  1. .gitattributes +10 -0
  2. EXAONE-3.5-32B-Instruct.Q2_K.gguf +3 -0
  3. EXAONE-3.5-32B-Instruct.Q3_K_L.gguf +3 -0
  4. EXAONE-3.5-32B-Instruct.Q3_K_M.gguf +3 -0
  5. EXAONE-3.5-32B-Instruct.Q3_K_S.gguf +3 -0
  6. EXAONE-3.5-32B-Instruct.Q4_K_M.gguf +3 -0
  7. EXAONE-3.5-32B-Instruct.Q4_K_S.gguf +3 -0
  8. EXAONE-3.5-32B-Instruct.Q5_K_M.gguf +3 -0
  9. EXAONE-3.5-32B-Instruct.Q5_K_S.gguf +3 -0
  10. EXAONE-3.5-32B-Instruct.Q6_K.gguf +3 -0
  11. EXAONE-3.5-32B-Instruct.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ EXAONE-3.5-32B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ EXAONE-3.5-32B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ EXAONE-3.5-32B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ EXAONE-3.5-32B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ EXAONE-3.5-32B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ EXAONE-3.5-32B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ EXAONE-3.5-32B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ EXAONE-3.5-32B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ EXAONE-3.5-32B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ EXAONE-3.5-32B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-32B-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f39df08c302f95a77c27d5bd42de58a78103da74e8077a75ade49172b6559f0c
3
+ size 11926383360
EXAONE-3.5-32B-Instruct.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a58fc5615388999d76cfe807e953c34cc7041a120c2afb6a3683899253a43a16
3
+ size 16795872000
EXAONE-3.5-32B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daa62c6d4fb9f00135936bdd846700c30eec020cd300a199f6fb9ff2625e230c
3
+ size 15493671680
EXAONE-3.5-32B-Instruct.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c94e44bd5cf2b78d91b36c98a24c2391c32c284b25d6bcb521e0f45ca93a13a
3
+ size 13962750720
EXAONE-3.5-32B-Instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd5fbb802776ee1a0a430bb2ffee4cb4ec897658410f97d315210aee3ed88bc2
3
+ size 19343747840
EXAONE-3.5-32B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a2c30eb0be7a32ed13081a1a8d385c1629d3b6fff63ce94faaebc4ab147ad95
3
+ size 18286324480
EXAONE-3.5-32B-Instruct.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a4bd2e49595fb806aa305d8ede86e3574663f2936377b7045f6e175605c3932
3
+ size 22696569600
EXAONE-3.5-32B-Instruct.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8870d31eb067dfbeda943269ee81c225fd2c9bd97e6938069a5f9736873717be
3
+ size 22078237440
EXAONE-3.5-32B-Instruct.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4069e65f2d558defd5ac16f2810c9da45dd258bfe5324e8555da1e81f96160a2
3
+ size 26258942720
EXAONE-3.5-32B-Instruct.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dcf25f363720f4e73e3fa787da4e4e1df2b7679d98435aa471a1e51c5ad46ca
3
+ size 34009557760