Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Saul-Instruct-v1-GGUF
like
5
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
legal
conversational
en
arxiv:2403.03883
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
e4989d2
Saul-Instruct-v1-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
82961f0a444d0f64636052e0f0210ee95c3a967504b016445054a5146abbabb3
e4989d2
verified
4 months ago
.gitattributes
2.23 kB
82961f0a444d0f64636052e0f0210ee95c3a967504b016445054a5146abbabb3
4 months ago
Saul-Instruct-v1.IQ4_XS.gguf
3.94 GB
LFS
6606b4a88da8230d89f7d7c18a84314fcfddc3f7497dce6be80407e7f76aff47
4 months ago
Saul-Instruct-v1.Q2_K.gguf
2.72 GB
LFS
0dc5c41ce0358b5e7ab2ccbea7c4d1b119a5e1d8e023c507217c3882e8bf58c0
4 months ago
Saul-Instruct-v1.Q3_K_L.gguf
3.82 GB
LFS
f4bcf2f45a39e077313faa0b38615c646e89146f8e28c2fcb9893c344165f8fd
4 months ago
Saul-Instruct-v1.Q3_K_M.gguf
3.52 GB
LFS
24a7f7f08b39916e87dbf562a96ee6d2ff596d87023a15e794aec21958be826a
4 months ago
Saul-Instruct-v1.Q3_K_S.gguf
3.16 GB
LFS
a6fd96ab2d2e9495b1378f38f8f59a56245c57deb40b98922cb92c5325f32114
4 months ago
Saul-Instruct-v1.Q4_K_M.gguf
4.37 GB
LFS
dd58900ab7d3d21fb54dfea6e4d51ec5b758690444de38dc7ab9d2a1853c102c
4 months ago
Saul-Instruct-v1.Q4_K_S.gguf
4.14 GB
LFS
a5e17129e3ad90e4f009b7f87aa77688525c5d203d9f907daef7d137abac0ebd
4 months ago
Saul-Instruct-v1.Q5_K_M.gguf
5.13 GB
LFS
a843ba1c78cf50a442d6b52b99913f6caa69fc82691225b64a0d321778228b70
4 months ago
Saul-Instruct-v1.Q5_K_S.gguf
5 GB
LFS
e83f651f9c4afeabc9e0d1910d6358aa5a906268d5c7326bfac2df097cd82e5b
4 months ago
Saul-Instruct-v1.Q6_K.gguf
5.94 GB
LFS
f60c13e35d5165308a47fac0d90d5f359fa9f64de22ceeb820fd2a7e81cc5bcf
4 months ago
Saul-Instruct-v1.Q8_0.gguf
7.7 GB
LFS
82961f0a444d0f64636052e0f0210ee95c3a967504b016445054a5146abbabb3
4 months ago
