|
--- |
|
tags: |
|
- GGUF |
|
- french-alpaca |
|
- merge |
|
- mergekit |
|
- french |
|
license: apache-2.0 |
|
--- |
|
# Vigalpaca-French-7B-ties-GGUF |
|
|
|
Vigalpaca-French-7B-ties is a merge of the following models: |
|
jpacifico/French-Alpaca-7B-Instruct-beta |
|
bofenghuang/vigostral-7b-chat |
|
|
|
base model : jpacifico/French-Alpaca-7B-Instruct-beta |
|
|
|
### Usage |
|
|
|
This quantized q8_0 GGUF version can be used on a CPU device, compatible with llama.cpp Ollama and LM Studio. |
|
|
|
Ollama Modelfile example : |
|
|
|
```bash |
|
FROM ./Vigalpaca-French-7B-ties-quantized-q8_0.gguf |
|
|
|
TEMPLATE """[INST] {{ .System }} {{ .Prompt }} [/INST]""" |
|
PARAMETER stop "[INST]" |
|
PARAMETER stop "[/INST]" |
|
SYSTEM """Tu es un assistant IA nommé Vigalpaca. Tu dois répondre de manière concise et bienveillante aux questions posées par l'utilisateur.""" |
|
|
|
``` |
|
|
|
### Limitations |
|
|
|
The Vigalpaca model is a quick demonstration that a base 7B model can be easily merged/fine-tuned to specialize in a particular language. |
|
It does not have any moderation mechanisms. |
|
|
|
- **Developed by:** Jonathan Pacifico. Vigostral model by Bofeng Huang (special thanks), 2024 |
|
- **Model type:** LLM |
|
- **Language(s) (NLP):** French |
|
- **License:** Apache-2.0 |
