Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Neuralsirkrishnaexperiment26Experiment24-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Neuralsirkrishnaexperiment26Experiment24-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
5578b13a35306a4fd6276753d1769d7dd502aa5bd695f3c915b6dda0ded8640d
5a1fbe2
verified
7 months ago
.gitattributes
2.53 kB
0c4dc5a0b1433c138cb34d43ac3b6c862d4c5f8b3998717772f1c7d64a4c72bc
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.IQ3_XS.gguf
3.02 GB
LFS
722c7a69c79bf2122625f054e68da5da8b109c93d6354b85cc8afce0c0618798
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.IQ4_XS.gguf
3.94 GB
LFS
5c451640a93dd7c1269bda78e6e60763f022309a136e8ae6b900dad21cfc86a4
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q2_K.gguf
2.72 GB
LFS
88d38339aaef79b71d5bb404d11c0eb46c3986167d406401eb0deb566d955aa0
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q3_K_L.gguf
3.82 GB
LFS
0f04f379ec886779773540fbb39188b339eb2a26d6ff6989b997848732468678
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q3_K_M.gguf
3.52 GB
LFS
c4506bb9ff8f5e95ea9a04b56da09ad35ce1caa09f4feecf3efefbd80f77bb32
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q3_K_S.gguf
3.16 GB
LFS
950c70cbc4cb2da16c3366ed1b83d1677cdb8dd9f32ed52bd4062e0d50d94e1a
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q4_K_M.gguf
4.37 GB
LFS
c66155e67006b2a52bf3c7ac926f676bfb3dc8637e2e07c720a5f0a78d6a4f79
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q4_K_S.gguf
4.14 GB
LFS
6635ffae927c0beae9e8c47dd0fa9b3f5d80471656e1c5d67dc813851d7eff2f
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q5_K_M.gguf
5.13 GB
LFS
e35831428376389d167d556c37019a69b0fb6160cac09612e4403e4de2a6941b
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q5_K_S.gguf
5 GB
LFS
743e35e9d626a2c489bedc2d9ccf7581541fbb40be2601bf812d3eb45aa0b787
7 months ago
Neuralsirkrishnaexperiment26Experiment24-7B.Q6_K.gguf
5.94 GB
LFS
0c4dc5a0b1433c138cb34d43ac3b6c862d4c5f8b3998717772f1c7d64a4c72bc
7 months ago
README.md
11.5 kB
5578b13a35306a4fd6276753d1769d7dd502aa5bd695f3c915b6dda0ded8640d
7 months ago
