Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
biology
medical
en
dataset:EleutherAI/pile
dataset:Open-Orca/OpenOrca
dataset:GAIR/lima
dataset:WizardLM/WizardLM_evol_instruct_V2_196k
arxiv:2309.09530
Eval Results
Inference Endpoints
has_space
text-generation-inference
Commit
•
0fb2793
1
Parent(s):
21f7eb2
e86da66d115eec5d903ca04f633f7493be320ef4b2030fed82feeb3d31e03db6
Browse files- .gitattributes +1 -0
- medicine-chat.Q4_K_M.gguf +3 -0
.gitattributes
CHANGED
|
@@ -39,3 +39,4 @@ medicine-chat.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 39 |
medicine-chat.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
medicine-chat.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
medicine-chat.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 39 |
medicine-chat.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
medicine-chat.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
medicine-chat.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
medicine-chat.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
medicine-chat.Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aa3a4e87b13628b6ad7081824cb22763d7b71634d99e820bc89a67294293324b
|
| 3 |
+
size 4081019936
|