README.md

metadata

base_model: >-
  NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3
inference: false
model_creator: NickyNicky
model_name: LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - gguf
  - ggml
  - quantized
  - q2_k
  - q3_k_xs
  - q3_k_m
  - q4_k_m
  - q5_k_m
  - q6_k
  - q8_0

NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Quantized GGUF model files for LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3 from NickyNicky

Name	Quant method	Size
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.fp16.gguf	fp16	496.82 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q2_k.gguf	q2_k	105.46 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_xs.gguf	q3_k_xs	115.32 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_m.gguf	q3_k_m	129.03 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q4_k_m.gguf	q4_k_m	155.67 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q5_k_m.gguf	q5_k_m	179.23 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q6_k.gguf	q6_k	204.26 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q8_0.gguf	q8_0	264.33 MB

Original Model Card: