Hugging Face's logo

second-state
/
Phi-3-mini-4k-instruct-GGUF

Text Generation
Transformers
GGUF
English
phi3
nlp
code
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
apepkuss79 commited on
Commit
c1a5c58
•
1 Parent(s): c74827f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -89,4 +89,4 @@ tags:
89
  | [Phi-3-mini-4k-instruct-Q8_0.gguf](https://huggingface.co/second-state/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct-Q8_0.gguf) | Q8_0 | 8 | 4.06 GB| very large, extremely low quality loss - not recommended |
90
  | [Phi-3-mini-4k-instruct-f16.gguf](https://huggingface.co/second-state/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct-f16.gguf) | f16 | 16 | 7.64 GB| |
91
 
92
- *Quantized with llama.cpp b2717.*
 
89
  | [Phi-3-mini-4k-instruct-Q8_0.gguf](https://huggingface.co/second-state/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct-Q8_0.gguf) | Q8_0 | 8 | 4.06 GB| very large, extremely low quality loss - not recommended |
90
  | [Phi-3-mini-4k-instruct-f16.gguf](https://huggingface.co/second-state/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct-f16.gguf) | f16 | 16 | 7.64 GB| |
91
 
92
+ *Quantized with llama.cpp b3333.*