Hugging Face's logo

TheBloke
/
Llama-2-70B-Chat-GGML

Text Generation
Transformers
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
Model card Files Community
16
TheBloke commited on
Commit
f5eccd3
•
1 Parent(s): 4064117

Initial GGML model commit

Browse files
Files changed (6) hide show
  1. .gitattributes +3 -0
  2. llama-2-70b-chat.ggmlv3.q6_K.z01 +3 -0
  3. llama-2-70b-chat.ggmlv3.q6_K.zip +3 -0
  4. llama-2-70b-chat.ggmlv3.q8_0.z01 +3 -0
  5. llama-2-70b-chat.ggmlv3.q8_0.z02 +3 -0
  6. llama-2-70b-chat.ggmlv3.q8_0.zip +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ llama-2-70b-chat.ggmlv3.q6_K.z01 filter=lfs diff=lfs merge=lfs -text
37
+ llama-2-70b-chat.ggmlv3.q8_0.z01 filter=lfs diff=lfs merge=lfs -text
38
+ llama-2-70b-chat.ggmlv3.q8_0.z02 filter=lfs diff=lfs merge=lfs -text
llama-2-70b-chat.ggmlv3.q6_K.z01 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3569f212f52711fb3be7acd42fec15effd5653a4745adae67e2723fbdf5bb0d
3
+ size 31457280000
llama-2-70b-chat.ggmlv3.q6_K.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a1aa5f494c80564f9e8772dc65a329ebe64d606af60ef564edc23fb384cbeca
3
+ size 25129799630
llama-2-70b-chat.ggmlv3.q8_0.z01 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa70c64d2d0b5ab01bb1b38f7224a2d9e7b5abc44fbe5cabcc8ea8087b58ab14
3
+ size 31457280000
llama-2-70b-chat.ggmlv3.q8_0.z02 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f7411aa75d577a69218ed0dfb701be0477551849e6a48c9d00a90f8da54f253
3
+ size 31457280000
llama-2-70b-chat.ggmlv3.q8_0.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22070bb92c03d86a0f30d873e08e41a2af6cd28359ce058d918821c6db600911
3
+ size 10313994190