Hugging Face's logo

featherless-ai-quants
/
abacusai-Smaug-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
m8than commited on
Commit
7c3fc16
•
1 Parent(s): 54faea4

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +104 -0
  2. README.md +47 -0
  3. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00001-of-00008.gguf +3 -0
  4. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00002-of-00008.gguf +3 -0
  5. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00003-of-00008.gguf +3 -0
  6. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00004-of-00008.gguf +3 -0
  7. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00005-of-00008.gguf +3 -0
  8. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00006-of-00008.gguf +3 -0
  9. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00007-of-00008.gguf +3 -0
  10. abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00008-of-00008.gguf +3 -0
  11. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00001-of-00006.gguf +3 -0
  12. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00002-of-00006.gguf +3 -0
  13. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00003-of-00006.gguf +3 -0
  14. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00004-of-00006.gguf +3 -0
  15. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00005-of-00006.gguf +3 -0
  16. abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00006-of-00006.gguf +3 -0
  17. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00001-of-00008.gguf +3 -0
  18. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00002-of-00008.gguf +3 -0
  19. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00003-of-00008.gguf +3 -0
  20. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00004-of-00008.gguf +3 -0
  21. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00005-of-00008.gguf +3 -0
  22. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00006-of-00008.gguf +3 -0
  23. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00007-of-00008.gguf +3 -0
  24. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00008-of-00008.gguf +3 -0
  25. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00001-of-00007.gguf +3 -0
  26. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00002-of-00007.gguf +3 -0
  27. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00003-of-00007.gguf +3 -0
  28. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00004-of-00007.gguf +3 -0
  29. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00005-of-00007.gguf +3 -0
  30. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00006-of-00007.gguf +3 -0
  31. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00007-of-00007.gguf +3 -0
  32. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00001-of-00007.gguf +3 -0
  33. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00002-of-00007.gguf +3 -0
  34. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00003-of-00007.gguf +3 -0
  35. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00004-of-00007.gguf +3 -0
  36. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00005-of-00007.gguf +3 -0
  37. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00006-of-00007.gguf +3 -0
  38. abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00007-of-00007.gguf +3 -0
  39. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00001-of-00009.gguf +3 -0
  40. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00002-of-00009.gguf +3 -0
  41. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00003-of-00009.gguf +3 -0
  42. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00004-of-00009.gguf +3 -0
  43. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00005-of-00009.gguf +3 -0
  44. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00006-of-00009.gguf +3 -0
  45. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00007-of-00009.gguf +3 -0
  46. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00008-of-00009.gguf +3 -0
  47. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00009-of-00009.gguf +3 -0
  48. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00001-of-00009.gguf +3 -0
  49. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00002-of-00009.gguf +3 -0
  50. abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00003-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,107 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
37
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
38
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
39
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
40
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
41
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
42
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
43
+ abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
44
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
45
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
51
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
59
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
60
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
61
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
62
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
63
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
64
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
65
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
66
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
67
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
68
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
69
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
70
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
71
+ abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
72
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
73
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
74
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
75
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
76
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
88
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
89
+ abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
90
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
91
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
92
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
93
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
94
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
95
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
96
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
97
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
98
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
99
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
100
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
101
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
102
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
103
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
104
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
105
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
106
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
107
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
108
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
109
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
110
+ abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
111
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
112
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
113
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
114
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
115
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
116
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
117
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
118
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
119
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
120
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
121
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
122
+ abacusai-Smaug-Llama-3-70B-Instruct-Q6_K/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
123
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00001-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
124
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00002-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
125
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00003-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
126
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00004-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
127
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00005-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
128
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00006-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
129
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00007-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
130
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00008-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
131
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00009-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
132
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00010-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
133
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00011-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
134
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00012-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
135
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00013-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
136
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00014-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
137
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00015-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
138
+ abacusai-Smaug-Llama-3-70B-Instruct-Q8_0/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0-00016-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
139
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: abacusai/Smaug-Llama-3-70B-Instruct
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # abacusai/Smaug-Llama-3-70B-Instruct GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS) | 36496.80 MB (folder) |
21
+ | Q2_K | [abacusai-Smaug-Llama-3-70B-Instruct-Q2_K](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K) | 25153.26 MB (folder) |
22
+ | Q3_K_L | [abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L) | 35420.03 MB (folder) |
23
+ | Q3_K_M | [abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M) | 32680.03 MB (folder) |
24
+ | Q3_K_S | [abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S) | 29480.03 MB (folder) |
25
+ | Q4_K_M | [abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M) | 40550.61 MB (folder) |
26
+ | Q4_K_S | [abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S) | 38478.11 MB (folder) |
27
+ | Q5_K_M | [abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_M) | 47635.86 MB (folder) |
28
+ | Q5_K_S | [abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q5_K_S) | 46403.36 MB (folder) |
29
+ | Q6_K | [abacusai-Smaug-Llama-3-70B-Instruct-Q6_K](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q6_K) | 55206.44 MB (folder) |
30
+ | Q8_0 | [abacusai-Smaug-Llama-3-70B-Instruct-Q8_0](https://huggingface.co/featherless-ai-quants/abacusai-Smaug-Llama-3-70B-Instruct-GGUF/tree/main/abacusai-Smaug-Llama-3-70B-Instruct-Q8_0) | 71501.78 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7d031defeccd802a1ea4fcd7a56013275c55a47f82662ccef48aded6d569e4b
3
+ size 4999733920
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3c7f2b44e5f783a1cad01f24968a4f2c275943554eb14a732b3487adf60eb7e
3
+ size 4974876320
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d22d220d8bb374bfa58c185f09ae11f368c493d416d4235c7b656aacc5ef6f58
3
+ size 4886009568
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f89fa4efca02e63b60d340e5694ce94d8bff1bc1355924b84853c30693351b72
3
+ size 4890498912
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a93e5ec5d71c8b2265a35548d2b256b8e74e1cbb214b99f2914ed790a86d5fe7
3
+ size 4890498912
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39ff347b5ad469223f0e56132e0914b4ab98a1d3ac96047a39d0729b37e9f117
3
+ size 4973827808
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b59972a7321b8bc564ef314f43ed4603f579e33e4c954a0605e357cc45eeea0f
3
+ size 4979627872
abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS/abacusai-Smaug-Llama-3-70B-Instruct-IQ4_XS-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e2d69fb711127d9c919dd8957a89e286a266704268a13d3d89fb4148c87d168
3
+ size 3674590784
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70b6dc30bf284f373709e4a4c6358c4bdd5cba5244613a73d60b8b877e1b8d27
3
+ size 4933709216
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5e849f6f2b865d05aa91839b567156e59a933a9cd32615f1c62208e66d32dbc
3
+ size 4955054560
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:237bb1d18eb29632cdcfad7e2ab33273bb9383bccee6bfcc3cd6e199f873a0e4
3
+ size 4990575328
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebacd8605171d6bc8527030dbd9e3fbc3059b43b34c6413506ae4c4d97081d9b
3
+ size 4972749088
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67997e5f928b4762fd7013ea08f3239343f1986dbef07ae1dbdd7f7e2ccb626a
3
+ size 4926152992
abacusai-Smaug-Llama-3-70B-Instruct-Q2_K/abacusai-Smaug-Llama-3-70B-Instruct-Q2_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2956e7d27de81f9e2dddfbfa6deeee1e7f8941f469333e64c56a9ed996254925
3
+ size 1596868032
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef55951585adc1f8298895e9a1ab8cd0341ee83a26fdf8777b171e8919e22ded
3
+ size 4936737952
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37201df6eb60be38c5bf1010149f306b9cff5817050387f8c34e48a3919f118c
3
+ size 4963375168
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa66b20204ce176590f01f38d0f761308e05030a9bf9cf1a8ecf617267e02391
3
+ size 4971304928
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3913b54abbc4c3c2bbfcdb79ed85602e9c6820b7169c9a4f1691f18377ac750f
3
+ size 4991457056
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc13ba436ebf195d89db3d6702ceab3232d9047785ded62249ce4bf9e2674fdd
3
+ size 4979955616
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:817cb67f96abfb0b7cbf24f0b8909df6ee80ed3b4635ed3f04c389c5360e851a
3
+ size 4982151072
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5d5b7558199293ccc88f8ee51cab7178d3d26ee5098d5f641ccc8654806c08d
3
+ size 4925167520
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_L-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a34627ee2bd4113176c5968f7c66548bf7a28a73bbdd5f94905503cab8f609c3
3
+ size 2390444192
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d0dbd4d63c11f4484e3be2d3bd6dde6cf23ce775775eedd17a0ea8e20dcf1e7
3
+ size 4939097376
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a934ad9aca01b300d82d764a87d064089e2a976af64a4b5f6b7058e012e33615
3
+ size 4919925184
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6d8262b984285bf2ea1ec022834568c6022c5de97e0ae29917e45f68b5c1f3d
3
+ size 4919925184
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91d10ca631d075ba82566fee4af775db1eac6c4889220087378129cd403a9733
3
+ size 4995881632
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1073ad380723a7e369397b435f9991ed0d9b4869387825b8a071f9a0bf882429
3
+ size 4986280352
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46e1cc93a6476a4dd6d7d44f276601a132bdf7ae3c90857e74f2a71b84f81a8a
3
+ size 4954528288
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_M-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3625ddc66d242760bb58d72b9fb02a34d7edf87008d43c4b81c0edce868135ca
3
+ size 4551857088
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dfba4c0b0d11290a904d99eb223eb79b6e1e9ee4c814d75a9d5a9562444e200
3
+ size 4998834400
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c17642a87164869985d431c01074209e823bd80d80b8392d4e82faad59528a92
3
+ size 4909472832
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2e2e3af4b722b0efc705839df42efaad1003872f81968b6a30d49ac43bd2b22
3
+ size 4976549216
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c420fa55e8b82d61bc02729226e89ceaac25d7b8c6050698c396b0b17d7d42f
3
+ size 4909440000
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4fd6d7cf0bde937e56ed3def9ca70c762b387a6743c4e74883cbebf7a22315f
3
+ size 4909440000
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7408beb026b7c76adc1a39c06d090e06143cb29ce9b56655d9a2184240d86f6
3
+ size 4976549216
abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q3_K_S-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d642a05039934890673bc63d3d2e36a4747ec79560ab78fbd7e593e21565eeb
3
+ size 1231766208
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7ce7436e3c10de95b6d6291eef8875bad9f6565677acd0576ebf4bc68180d17
3
+ size 4951498880
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e437de629af836a53093c8ba481ccf8200f150ddefd78148f64b1f412cf95cbd
3
+ size 4989490304
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a77b07ef8840a5f9d1ced054e01afba8b7f3234f8a1543b091e0c41c3f172c54
3
+ size 4932801728
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20e9b5d0d4c03a48234de53347b0e7c8bbff26a6814460c2573780e1be48af03
3
+ size 4878112064
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:672faf622963ce91ec8ead2d3ccd7a0e0d1784b41ead10936a94bf8b89d3df50
3
+ size 4876997952
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeaa75c6db711f9828f0ef5eb15f707dc8db4e642c7273b573119615f392455b
3
+ size 4965569728
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:657156f8b46a6daadb783f84db8c832b40f51a6781e5f0a0b4ec291dbd3e9054
3
+ size 4895052928
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30f74b4c3faf5769925aebf1b7855381fd516233d43bdea00dcd2fc593e32379
3
+ size 4992668928
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c26450239d3fd083c23e8f346736247c8642f6e0d596923436e519456d6a699
3
+ size 3038202144
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ce57dce9c388270d73d7633e05a68625ccc81df2d7b3c0918e81ea97cf9abd5
3
+ size 4986626304
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:776e0e2a75bcdcede4855cc4d0cc67def3ee91227507048a36159722aa228600
3
+ size 4939454048
abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S/abacusai-Smaug-Llama-3-70B-Instruct-Q4_K_S-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd0414714ae8e2bf4d4a67368d279e4c64f458468a66b1a238b61d36b464ac1a
3
+ size 4956263904