Hugging Face's logo

second-state
/
Llama-3.3-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
llama
facebook
meta
llama-3
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
87291d4
·
verified ·
1 Parent(s): 0bb5241

Update models

Browse files
Files changed (19) hide show
  1. Llama-3.3-70B-Instruct-Q2_K.gguf +1 -1
  2. Llama-3.3-70B-Instruct-Q3_K_L.gguf +1 -1
  3. Llama-3.3-70B-Instruct-Q3_K_M.gguf +1 -1
  4. Llama-3.3-70B-Instruct-Q3_K_S.gguf +1 -1
  5. Llama-3.3-70B-Instruct-Q4_0.gguf +1 -1
  6. Llama-3.3-70B-Instruct-Q4_K_M.gguf +1 -1
  7. Llama-3.3-70B-Instruct-Q4_K_S.gguf +1 -1
  8. Llama-3.3-70B-Instruct-Q5_0.gguf +1 -1
  9. Llama-3.3-70B-Instruct-Q5_K_S.gguf +1 -1
  10. Llama-3.3-70B-Instruct-Q6_K-00001-of-00002.gguf +1 -1
  11. Llama-3.3-70B-Instruct-Q6_K-00002-of-00002.gguf +1 -1
  12. Llama-3.3-70B-Instruct-Q8_0-00001-of-00003.gguf +1 -1
  13. Llama-3.3-70B-Instruct-Q8_0-00002-of-00003.gguf +1 -1
  14. Llama-3.3-70B-Instruct-Q8_0-00003-of-00003.gguf +1 -1
  15. Llama-3.3-70B-Instruct-f16-00001-of-00005.gguf +1 -1
  16. Llama-3.3-70B-Instruct-f16-00002-of-00005.gguf +1 -1
  17. Llama-3.3-70B-Instruct-f16-00003-of-00005.gguf +1 -1
  18. Llama-3.3-70B-Instruct-f16-00004-of-00005.gguf +1 -1
  19. Llama-3.3-70B-Instruct-f16-00005-of-00005.gguf +1 -1
Llama-3.3-70B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d765d3f22082e2ff2ff6b0f15d182b8404d3193cb9ade682db59fc9c54510ea4
3
  size 26375113408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1d7f1294e4462b310560ca3a43f24df7023b7702712ccbb65f8ac0f8d917814
3
  size 26375113408
Llama-3.3-70B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e67c5202a95ad3b69654a02cf71ded6b7a28835fcdebf269b0c27ec5bdb91bbb
3
  size 37140597440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a058f6687f8dc4910b3807467d7043355f4a5710d2260b57b9a4900b1097001f
3
  size 37140597440
Llama-3.3-70B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e3780542544af43a9e2921fad572ca4e5d8abb6fdeae2d80b7041972c23f800
3
  size 34267499200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36894f6940358ec0204f9cf8d117153f24249523a818594863f2eeb0cfc50571
3
  size 34267499200
Llama-3.3-70B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e75160728a1c316a5434ae68d9d2cd6217e8d062f78966a9a0088275543e2cb
3
  size 30912056000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e9888150a6173933d60f3b666128dd868e1f29e8360c2fe4bd190e6c33ec264
3
  size 30912056000
Llama-3.3-70B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c176908d00f6753b5e8891cac84fb448c3e1e27568df202f0d97a054c8378323
3
  size 39969737408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfb52cdeed3b2030a2dc9f48f200c3e440ac275ad791908ab9fefbb79eca9f77
3
  size 39969737408
Llama-3.3-70B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1795ae4186d7c32690fbdc5082cf4308507da572769a331df3b83a8962f46c38
3
  size 42520398528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:516f4f2eacca4294f4e0afe3db48a66db934f6f76f14eda12eb2d77278b5d964
3
  size 42520398528
Llama-3.3-70B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ed386e8ababe505caabb74ff56647b3f4d5bd85a97580d95d671d83a7a9787e
3
  size 40347224768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0038d89985f144e676d62c2036bc31891f0f5d54a4e2a257434da84037f3d901
3
  size 40347224768
Llama-3.3-70B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f48f0d68dc04c25890f557e38b5f3945c8a0d73c0e3fd85da37a96c5bb54dbb
3
  size 48657451712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c99853d571fca53bac5b19e95090c17dd7d15f599e976ad1187369ae0cedad7
3
  size 48657451712
Llama-3.3-70B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f73649922091687ff7c11a81e94bd5f4c688335edd0731bd6f94c56532c377d6
3
  size 48657451712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b059da6807ba93f92d6f4d3882d013e806ee36880b730e3e557c8be1a5371b16
3
  size 48657451712
Llama-3.3-70B-Instruct-Q6_K-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f654645bd07354f7528a2981fc622c332e4109b75e3e1a7b7f74d37ae0428239
3
  size 29933778976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d82800668c98f1c1cb936173fb75870f721054c807d0fba741cb894eb509d55
3
  size 29933778976
Llama-3.3-70B-Instruct-Q6_K-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f50428a8c9912e949f5273174e66c9febdc7cd21617595de2dc0e5c9df536434
3
  size 27954369376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab932c7fce61b9772c5d527b3dca855cdcc05c22680a0a80ff98c882f12d652d
3
  size 27954369376
Llama-3.3-70B-Instruct-Q8_0-00001-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e5e41b74a6446075b12cdd395980550f7e06043e181dfb4f6b6bf6b783965ad
3
  size 29926007648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35a270a60a047a3d4ea1deb4e71c0f73f1d565b804e4e99641d465525db8ba83
3
  size 29926007648
Llama-3.3-70B-Instruct-Q8_0-00002-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:14f57abb1e99190c4220f4cad19e29568e911e4f5679563d00d0d3b8a36e5057
3
  size 29753427360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55aefe880d37f7bbf67ff30b766e4e53098bf632d6f030a65dc8d70ecc14a639
3
  size 29753427360
Llama-3.3-70B-Instruct-Q8_0-00003-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5652cbe8278df62cbff36f53bf5e6cf714c555def43aa5320f66e208bfb5aa9a
3
  size 15295619840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e01b37346e8f46deead83864025c0983d564b3404551693c58e45b2c3bcdf49f
3
  size 15295619840
Llama-3.3-70B-Instruct-f16-00001-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f3b1dbe9bc1c0d73a5dda2376cfe024017058b4f16c372ef684f5b8a464b8049
3
  size 29960438944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f6349f217735ab0dc0e3703f7c3c867d0a61479b91306997418b18630c741e1
3
  size 29960438944
Llama-3.3-70B-Instruct-f16-00002-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:edfba918b25001c2faa0d210d8639dd468580a2b9b2932efac040061601c11c7
3
  size 29562578048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e660feb0d0d2d7e1fed0a94aee6a9d6ca7ab10f1cc660e2730d3be2941e9ff71
3
  size 29562578048
Llama-3.3-70B-Instruct-f16-00003-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f89cf5536552828a769d5eaaf842c9ae48d012d153f79b70253a5079497a7075
3
  size 29864633824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:883a7230a36ebc1e822bed71cd82a6f8235d277aadeaf67f4812cffb1ed561cf
3
  size 29864633824
Llama-3.3-70B-Instruct-f16-00004-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90a444ac7a750ee239565df4c62f62c884d21f9636c16ee909dde7c6965293cc
3
  size 29562545216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4f5a58a434852bd6ebe68fc95c6030b3d4ccfe6be45edba8e9d5cd27ba59880
3
  size 29562545216
Llama-3.3-70B-Instruct-f16-00005-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6eec501b8f6258f7684cf3d3808ac499bd0ac06b2c52a612fe7810e4b73a45b5
3
  size 22167722464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d206ce9e696c83d06a464374bf2f116cb38530b09910a415447f97e54e698362
3
  size 22167722464