Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28Neuralsirkrishna-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
8c7cc89
Experiment28Neuralsirkrishna-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
b9c1b7fe5859ba5768a86e960c72e48521512a19ba3ce0e3969ece337a806bca
8c7cc89
verified
9 months ago
.gitattributes
Safe
2.4 kB
7e34e0305e8da6660991396773a2189324c83f9acf3a5bbd3124e6c62ee0993d
9 months ago
Experiment28Neuralsirkrishna-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
5d28a30458d7c86b11358fc128cd9c439f0f9f5b104038ab8454c5aec8d61a6f
9 months ago
Experiment28Neuralsirkrishna-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
cc629a76ab750167a89fd08a98b70b97850bbc14322d51c808bae967e847fa34
9 months ago
Experiment28Neuralsirkrishna-7B.Q2_K.gguf
Safe
2.72 GB
LFS
feebe946127899b0f421f75f036f9777d833a4c40dc6d7bfab07d90066dfcf45
9 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
39567cf292974d2d0571100efc134ec9a67c439ed94dc3b381245a48f5d56843
9 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
91147257bfe6e77630f189e752fc90d1c89c7fd601a628bc69b59f1f12797dd0
9 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
10b404582169787ddcc257ec9ead2e21530e395f512b556e5767a3c6ce5c30c2
9 months ago
Experiment28Neuralsirkrishna-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
f29f4503722446df3bf5b69f5d96f0b38e85b3688185149654a7f5930e997d1f
9 months ago
Experiment28Neuralsirkrishna-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
288b2a6dd5ed20b840c0c33be36c01c57951a81cd4b84ab6c7c619871452625d
9 months ago
Experiment28Neuralsirkrishna-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
62e5d3e5aad9150f4c4eda59318b304823f286a36421af7d087639a42335c1f7
9 months ago
Experiment28Neuralsirkrishna-7B.Q5_K_S.gguf
Safe
5 GB
LFS
5f6c3969cb307a917c5a950291cbab591a3c42817181229319aa03aaff78a24b
9 months ago
Experiment28Neuralsirkrishna-7B.Q6_K.gguf
Safe
5.94 GB
LFS
7e34e0305e8da6660991396773a2189324c83f9acf3a5bbd3124e6c62ee0993d
9 months ago
README.md
Safe
11.2 kB
b9c1b7fe5859ba5768a86e960c72e48521512a19ba3ce0e3969ece337a806bca
9 months ago