File size: 1,011 Bytes
2420551 b489574 caf4307 7b21608 e0a2f6f 7b21608 e0a2f6f 7b21608 e0a2f6f 7b21608 ead2291 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
license: apache-2.0
datasets:
- SeacomSrl/rag-data
language:
- it
---
# Uploaded model
- **Developed by:** [Toti Riccardo](https://www.linkedin.com/in/riccardo-toti/)
- **License:** apache-2.0
- **Finetuned from model :** [unsloth/Phi-3-medium-4k-instruct](https://huggingface.co/unsloth/Phi-3-medium-4k-instruct) on [Seacom/rag-data](https://huggingface.co/datasets/SeacomSrl/rag-data) an italian translated dataset.
## Evaluation
For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
Here's a breakdown of the performance metrics:
| Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc |m_mmlu_pro_it | Average |
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|:--------|
| **Accuracy Normalized** | 69.35 | 49.1 | 69.53 | 0.3913 |62.66 | |