ExllamaV2 version of model created by the work of IkariDev + Undi95

Original Card https://huggingface.co/IkariDev/Athena-v2

Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.


image/png

Experimental Athena v2 model. Use Alpaca format.

Description

This repo contains fp16 files of Athena-V2.

Models and loras used

  • Xwin-LM/Xwin-LM-13B-V0.1
  • Undi95/ReMM-v2.2-L2-13B
  • Undi95/MLewd-L2-13B-v2-3
  • Brouz/Slerpeno
  • boomerchan/Magpie-13b
[Xwin (0.30) + ReMM v2.2 (0.70)](0.45) x [[Xwin (0.40) + MLewd v2-3 (0.60)](0.80) + [Slerpeno(0.50) + Magpie-13b(0.50)](0.20)](0.55)

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

HUGE thanks to Undi95 for doing the merging (Recipe was my idea, he merged)

Downloads last month
12
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.