Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
biology
medical
en
dataset:EleutherAI/pile
dataset:Open-Orca/OpenOrca
dataset:GAIR/lima
dataset:WizardLM/WizardLM_evol_instruct_V2_196k
arxiv:2309.09530
Eval Results
Inference Endpoints
has_space
text-generation-inference
Commit
•
fe5883d
1
Parent(s):
ff42ece
f794e8afae689920393b3c615ec264f4023284dc3e6e801c46c27cc6d5c37a14
Browse files- .gitattributes +1 -0
- medicine-chat.Q6_K.gguf +3 -0
.gitattributes
CHANGED
|
@@ -43,3 +43,4 @@ medicine-chat.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 43 |
medicine-chat.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
medicine-chat.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
medicine-chat.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 43 |
medicine-chat.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
medicine-chat.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
medicine-chat.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
medicine-chat.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
medicine-chat.Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2574c11dd913e5626e7c15f5b809fb67c1478372d5e20c3fd81feed001ac8c4
|
| 3 |
+
size 5529210944
|