Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
alfred-40B-1023-GGUF
like
5
Transformers
GGUF
4 datasets
5 languages
falcon
falcon-40b
long-context
NTK-YaRN
text-generation-inference
arxiv:
2306.15595
arxiv:
2309.00071
arxiv:
2307.03172
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
main
alfred-40B-1023-GGUF
1 contributor
History:
15 commits
TheBloke
Upload README.md
584b76f
11 months ago
.gitattributes
2.28 kB
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
README.md
29.5 kB
Upload README.md
11 months ago
alfred-40b-1023.Q2_K.gguf
17.4 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q3_K_L.gguf
21.6 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q3_K_M.gguf
20.1 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q3_K_S.gguf
18.3 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q4_0.gguf
23.8 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q4_K_M.gguf
25.5 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q4_K_S.gguf
23.8 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q5_0.gguf
29 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q5_K_M.gguf
30.6 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q5_K_S.gguf
29 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q6_K.gguf
34.5 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
alfred-40b-1023.Q8_0.gguf
44.5 GB
LFS
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
config.json
30 Bytes
GGUF model commit (made with llama.cpp commit 947f64f)
11 months ago
