--- license: apache-2.0 datasets: - totally-not-an-llm/EverythingLM-data-V2-sharegpt language: - en library_name: transformers --- Buy Me A Coffee This is [OpenLLaMA 3B V2](https://huggingface.co/openlm-research/open_llama_3b_v2) finetuned on [EverythingLM Data V2(ShareGPT format)](https://huggingface.co/datasets/totally-not-an-llm/EverythingLM-data-V2-sharegpt) for 2 epochs. Prompt template: ``` ### HUMAN: {prompt} ### RESPONSE: ``` q4_1 GGML quant available [here](https://huggingface.co/NikolayKozloff/Marx-3B-V2/).
q4_1 GGUF quant available [here]( https://huggingface.co/NikolayKozloff/Marx-3B-V2-GGUF/). # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_acrastt__Marx-3B-V2) | Metric | Value | |-----------------------|---------------------------| | Avg. | 36.89 | | ARC (25-shot) | 44.03 | | HellaSwag (10-shot) | 72.92 | | MMLU (5-shot) | 27.84 | | TruthfulQA (0-shot) | 39.92 | | Winogrande (5-shot) | 66.54 | | GSM8K (5-shot) | 1.21 | | DROP (3-shot) | 5.8 | # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_acrastt__Marx-3B-V2) | Metric | Value | |-----------------------|---------------------------| | Avg. | 36.89 | | ARC (25-shot) | 44.03 | | HellaSwag (10-shot) | 72.92 | | MMLU (5-shot) | 27.84 | | TruthfulQA (0-shot) | 39.92 | | Winogrande (5-shot) | 66.54 | | GSM8K (5-shot) | 1.21 | | DROP (3-shot) | 5.8 |