Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
NeuralsynthesisInex12-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
NeuralsynthesisInex12-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
9dda9246353af066ebe4b1bc142193fed2a0b2fc20f6a709e1c4bf195795df06
246f2b4
verified
6 months ago
.gitattributes
Safe
2.31 kB
e0950436e5965ab6777d64d1597607b9b409fc780e4fde9f6ed28e428fc5a40e
6 months ago
NeuralsynthesisInex12-7B.Q2_K.gguf
Safe
2.72 GB
LFS
b804aadbbaf770eea1237ff4653fc91a2ccc1946e89c616d427fa42e69181433
6 months ago
NeuralsynthesisInex12-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
adbc141c6be028d5bd6aa3eedb1d071ed9dea89c0f2ffe6445fa380c5651ad7f
6 months ago
NeuralsynthesisInex12-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
5c08538c133e532647361bdc3bafd9039983dd1445e1d4fa6cad6f2fbae26e9e
6 months ago
NeuralsynthesisInex12-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
d65fdf20d8d9d51579f9b72fac951e6aeed333c90d64e769da7e61ab49ec8e5a
6 months ago
NeuralsynthesisInex12-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
050cd504df5d5dee68b3c187ebdbafa6e5c3238ba69d081b16c0c65b7f45f7c8
6 months ago
NeuralsynthesisInex12-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
055a87bf5006178a5fdf07cd284ab2ca95ca49e1cf3e51124e1039b7cebc98b9
6 months ago
NeuralsynthesisInex12-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
b4c6b78c05c847ae83a62aeceb04b85a8263185b8051c0491e74cc644250bf84
6 months ago
NeuralsynthesisInex12-7B.Q5_K_S.gguf
Safe
5 GB
LFS
685412f86020958041b2007a1d19c671b51ca6cad4608f21c5cdcecd55ba6c16
6 months ago
NeuralsynthesisInex12-7B.Q6_K.gguf
Safe
5.94 GB
LFS
e6eb2c83267f0b59b5184a5b9518105ac2b1f760ae94b8e49048a902a1d43a9e
6 months ago
NeuralsynthesisInex12-7B.Q8_0.gguf
Safe
7.7 GB
LFS
a8939051785819494508e80ff858efe62615ab1bcad558c0d5b8db492a9f2f99
6 months ago
NeuralsynthesisInex12-7B.fp16.gguf
Safe
14.5 GB
LFS
e0950436e5965ab6777d64d1597607b9b409fc780e4fde9f6ed28e428fc5a40e
6 months ago
README.md
Safe
3.26 kB
9dda9246353af066ebe4b1bc142193fed2a0b2fc20f6a709e1c4bf195795df06
6 months ago
