French Pro model

This version aims to be a multilingual model (EN 🇺🇸 + FR 🇫🇷) to refine the specific professional tasks in French.

Dataset

EnnoAi-Pro has been trained on a French dataset to enhance its analysis and response quality. The dataset contains ~275K high-quality training samples of professional and general strategic themes.

Tuning

We use specific recipes with QLora methods to increase accuracy in advanced RAG contexts.

Prompt Format

We use the default ChatML format with system role support.

<|begin_of_text|><|im_start|>system
{SYSTEM_CONTEXT}<|im_end|>
<|im_start|>user
{USER_ENTRY}<|im_end|>
<|im_start|>assistant
{ASSISTANT_ENTRY}<|im_end|>

This model is under construction

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 12.17
IFEval (0-Shot) 31.95
BBH (3-Shot) 17.51
MATH Lvl 5 (4-Shot) 0.15
GPQA (0-shot) 1.57
MuSR (0-shot) 9.08
MMLU-PRO (5-shot) 12.79
Downloads last month
21
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Enno-Ai/EnnoAi-Pro-Llama-3-8B

Quantizations
1 model

Evaluation results