Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Phi-3-Context-Obedient-RAG-GGUF
like
6
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
phi3
conversational
custom_code
Inference Endpoints
License:
cc-by-sa-4.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
refs/pr/1
Phi-3-Context-Obedient-RAG-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
9e383fd4aadc860cae2bc0dbe7ed48a56d445db3353fa1b0fb61dfcdb8a7c022
d17594c
verified
6 months ago
.gitattributes
Safe
2.34 kB
9e383fd4aadc860cae2bc0dbe7ed48a56d445db3353fa1b0fb61dfcdb8a7c022
6 months ago
Phi-3-Context-Obedient-RAG.Q2_K.gguf
Safe
1.42 GB
LFS
0b3417ab82c083c3eb7deabcaa0bac1812774f58e5c2f0ffb69845b8ccd28136
6 months ago
Phi-3-Context-Obedient-RAG.Q3_K_L.gguf
Safe
2.09 GB
LFS
58c01dd032c4bdf16eaeb0f9d0086ee9cb5d413f19f887dc022a2f6b4eff890f
6 months ago
Phi-3-Context-Obedient-RAG.Q3_K_M.gguf
Safe
1.96 GB
LFS
0c602f1ca1edf5d5b7a4b47c1da8343b6ac111579f5953a71a1d6f9cd806c869
6 months ago
Phi-3-Context-Obedient-RAG.Q3_K_S.gguf
Safe
1.68 GB
LFS
9e383fd4aadc860cae2bc0dbe7ed48a56d445db3353fa1b0fb61dfcdb8a7c022
6 months ago
Phi-3-Context-Obedient-RAG.Q4_K_M.gguf
Safe
2.39 GB
LFS
5bd10eb16bde5f63d946d52a63aec28c1dcc01c4c0fdea6a52d17d3367c1bfae
6 months ago
Phi-3-Context-Obedient-RAG.Q4_K_S.gguf
Safe
2.19 GB
LFS
eba0747fc33ab9c20549b4ced91209cbe9b612994d9a230632885046272f8706
6 months ago
Phi-3-Context-Obedient-RAG.Q5_K_M.gguf
Safe
2.82 GB
LFS
568598357ea84c71e59a9a4419096423236b574d58f16a4a31bb82312a300fa4
6 months ago
Phi-3-Context-Obedient-RAG.Q5_K_S.gguf
Safe
2.64 GB
LFS
82e61277e6e45c57d7a5f794b85a5fa2f004ec5f6909268823f2753d98817cd9
6 months ago
Phi-3-Context-Obedient-RAG.Q6_K.gguf
Safe
3.14 GB
LFS
13c4b88ce036cc11f71273e954be9adb99ef4d3df794246e8a5b17620c31b51f
6 months ago
Phi-3-Context-Obedient-RAG.Q8_0.gguf
Safe
4.06 GB
LFS
cded3cf6dcd64a41007651efa15981f53e9023d63df04a1d1d7259aeb8a92e27
6 months ago
Phi-3-Context-Obedient-RAG.fp16.gguf
Safe
7.64 GB
LFS
bd314fd6c642c92eba845482c4a6b4c0e58cbbac79b13c9dfa9cac41c8b40841
6 months ago
README.md
Safe
3.21 kB
9e383fd4aadc860cae2bc0dbe7ed48a56d445db3353fa1b0fb61dfcdb8a7c022
6 months ago
