Hugging Face's logo

ChasapasK
/
ministral-3b-instruct-q8-GGUF

Text Generation
Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
ministral-3b-instruct-q8-GGUF
File size: 1,050 Bytes 
8ae3c62
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
 

---

library_name: transformers
inference:
  parameters:
    temperature: 1
    top_p: 0.95
    top_k: 40
    repetition_penalty: 1.2
license: apache-2.0
language:
- en
pipeline_tag: text-generation

---



# ChasapasK/ministral-3b-instruct-GGUF
This is gguf version of [ministral/Ministral-3b-instruct](https://huggingface.co/ministral/Ministral-3b-instruct) created using llama.cpp

8-bit (Q8) quantized model 

# Original Model Card



![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/AeJJFLB8s_wIaCKpNfac1.jpeg)



### Model Description

<!-- Provide a longer summary of what this model is. -->

Ministral is a series of language model, build with same architecture as the famous Mistral model, but with less size.

- **Model type:** A 3B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
- **Language(s) (NLP):** Primarily English
- **License:** Apache 2.0
- **Finetuned from model:** [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)