YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Quantization made by Richard Erkhov.
Neural-SOVLish-Devil-8B-L3 - GGUF
- Model creator: https://huggingface.co/saishf/
- Original model: https://huggingface.co/saishf/Neural-SOVLish-Devil-8B-L3/
Original model description:
license: cc-by-nc-4.0 library_name: transformers tags: - mergekit - merge base_model: - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/BlueMoon_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Smarts_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Luna_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Aura_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/RP_Format_QuoteAsterisk_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated model-index: - name: Neural-SOVLish-Devil-8B-L3 results: - task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics: - type: acc_norm value: 69.11 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics: - type: acc_norm value: 84.77 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics: - type: acc value: 69.02 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics: - type: mc2 value: 59.05 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics: - type: acc value: 78.3 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics: - type: acc value: 73.09 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=saishf/Neural-SOVLish-Devil-8B-L3 name: Open LLM Leaderboard
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
This is another "SOVL" style merge, this time using mlabonne/NeuralDaredevil-8B-abliterated.
Daredevil is the first abliterated model series i've tried that feels as smart as base llama-3-instruct while also being willing to give instructions to do all kinda of illegal things
Neural daredevil is trained further on the original abliterated model, which should result in a better experience in most scenarios. (A bandaid for the damage abliteration causes)
This model should do well in rp, I'm yet to test it (waiting for gguf files @_@)
Merge Method
This model was merged using the Model Stock merge method using mlabonne/NeuralDaredevil-8B-abliterated as a base.
Models Merged
The following models were included in the merge:
- mlabonne/NeuralDaredevil-8B-abliterated + ResplendentAI/BlueMoon_Llama3
- mlabonne/NeuralDaredevil-8B-abliterated + ResplendentAI/Smarts_Llama3
- mlabonne/NeuralDaredevil-8B-abliterated + ResplendentAI/Luna_Llama3
- mlabonne/NeuralDaredevil-8B-abliterated + ResplendentAI/Aura_Llama3
- mlabonne/NeuralDaredevil-8B-abliterated + ResplendentAI/RP_Format_QuoteAsterisk_Llama3
Configuration
The following YAML configuration was used to produce this model:
models:
- model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Aura_Llama3
- model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Smarts_Llama3
- model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Luna_Llama3
- model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/BlueMoon_Llama3
- model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
merge_method: model_stock
base_model: mlabonne/NeuralDaredevil-8B-abliterated
dtype: bfloat16
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 72.22 |
| AI2 Reasoning Challenge (25-Shot) | 69.11 |
| HellaSwag (10-Shot) | 84.77 |
| MMLU (5-Shot) | 69.02 |
| TruthfulQA (0-shot) | 59.05 |
| Winogrande (5-shot) | 78.30 |
| GSM8k (5-shot) | 73.09 |
- Downloads last month
- 5
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.