Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Goliath-longLORA-120b-rope8-32k-fp16-GGUF
like
9
Transformers
GGUF
llama
text-generation-inference
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
cfb3bfd
Goliath-longLORA-120b-rope8-32k-fp16-GGUF
1 contributor
History:
10 commits
TheBloke
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
cfb3bfd
verified
8 months ago
.gitattributes
3.08 kB
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q2_K.gguf
43.2 GB
LFS
GGUF model commit (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_L.gguf-split-a
30.8 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_L.gguf-split-b
30.8 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_M.gguf-split-a
28.3 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_M.gguf-split-b
28.3 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_S.gguf-split-a
25.4 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q3_K_S.gguf-split-b
25.4 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_0.gguf-split-a
33.2 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_0.gguf-split-b
33.2 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_K_M.gguf-split-a
35.3 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_K_M.gguf-split-b
35.3 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_K_S.gguf-split-a
33.4 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q4_K_S.gguf-split-b
33.4 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q5_0.gguf-split-a
40.5 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q5_0.gguf-split-b
40.5 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q5_K_S.gguf-split-a
40.5 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago
goliath-longlora-120b-rope8-32k-fp16.Q5_K_S.gguf-split-b
40.5 GB
LFS
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit a1d6df1)
8 months ago