Hugging Face's logo

MaziyarPanahi
/
SmolLM2-1.7B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
2
MaziyarPanahi commited on
Commit
6745498
•
1 Parent(s): c29de74

Upload folder using huggingface_hub (#2)

Browse files

- ec10ed812a2fa80006ba3ce7255872478c9821081a9b9af75a00395b73cd6441 (a4f50ecacbf69bfbcbc881802386faa3a2d70e6d)
- d594744f99ea87722c8c7cb0d1b7767417d83f29ff893943602e37b7ca8dbfe7 (8bf056d2f861d1794a3ea8f921b8e2411d8b0997)
- 947cc64e57c9be64634847b79f3e167e87b061876651b257e46875618f918c97 (e1f9481839d8ce74a2383430d0b31a206f150c99)
- dbaa81ab2cf8487c2e27079f4f7af6185528008ed2d416f53840d27143c46218 (5bbf5c7a0f9920eb1af17e9ae9234356297396fb)
- 04ef34c58fec10526a0c9ee4c9156277b00b1732a39afff4410dfbf558f39198 (a2b1bb65f77d969500eaacd66931d26d6503b9f1)
- 4460ae7f02b7d895aa40bf831fb474dfd7a6bac3dcdd2a9d5c9d4bba607da178 (50819a36917a61b2ba95f70d66628265084a4b65)
- 2e648332edc7e7493c43e8bc7de1b78e82f0432248de6bf2a55e0ace1c81005e (22bf1e42776374f2f7aeb43b33f2a87e55a3b371)
- 15e22bdfcce52ee95cc1234f761689cfff43506223bc1d37a4ee83278b485a56 (3fa3790b025ad2a278f262ff100f0f3d2bb20439)

Files changed (6) hide show
  1. .gitattributes +5 -0
  2. SmolLM2-1.7B-Instruct.Q2_K.gguf +3 -0
  3. SmolLM2-1.7B-Instruct.Q3_K_L.gguf +3 -0
  4. SmolLM2-1.7B-Instruct.Q3_K_M.gguf +3 -0
  5. SmolLM2-1.7B-Instruct.Q4_K_M.gguf +3 -0
  6. SmolLM2-1.7B-Instruct.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,8 @@ SmolLM2-1.7B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
  SmolLM2-1.7B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
  SmolLM2-1.7B-Instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmolLM2-1.7B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
39
  SmolLM2-1.7B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
  SmolLM2-1.7B-Instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmolLM2-1.7B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ SmolLM2-1.7B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
+ SmolLM2-1.7B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ SmolLM2-1.7B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ SmolLM2-1.7B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ SmolLM2-1.7B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolLM2-1.7B-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f8540bd01d96bfae7635d35e4fb443ec202d2da1104cbb13aeb5edfd5275c3d
3
+ size 674583456
SmolLM2-1.7B-Instruct.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f96c2fa02ce15ff8013567ec5e44756df89f922c2840872f2034a4df516b584a
3
+ size 932533152
SmolLM2-1.7B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:288a6a081791fd3a5fa5c4402e3cdf7239d5d4515d69726555701d7628740cd7
3
+ size 860181408
SmolLM2-1.7B-Instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eed15c92fa16bbf543050ceee2a0b9c62107dadaee1bb44c8d6076584604caa
3
+ size 1055609760
SmolLM2-1.7B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b59b1fa60253e53b848b18ab215e2a69df5c7ea3b13a6aabf77bec3ead405ad
3
+ size 999117728