mpasila
/

mistral-7b-v0.1-layla-v4-exl2-4bpw

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This is an ExLlamaV2 quantized model in 4bpw of l3utterfly/mistral-7b-v0.1-layla-v4 using the default calibration dataset.

Original Model card:

Model Card

Model Description

Mistral 7B fine-tuned by the OpenHermes 2.5 dataset optimised for multi-turn conversation and character impersonation.

The dataset has been pre-processed by doing the following:

remove all refusals
remove any mention of AI assistant
split any multi-turn dialog generated in the dataset into multi-turn conversations records
added nfsw generated conversations from the Teatime dataset

Developed by: l3utterfly
Funded by: Layla Network
Model type: Mistral
Language(s) (NLP): English
License: Apache-2.0
Finetuned from model: Mistral 7B

Uses

Base model used by Layla - the offline personal assistant: https://www.layla-network.ai

Help & support: https://discord.gg/x546YJ6nYC

Prompt:

USER:
ASSISTANT:

Downloads last month: 18

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including mpasila/mistral-7b-v0.1-layla-v4-exl2-4bpw

ExLlamaV2 quantizations

All my EXL2 quants here. • 32 items • Updated May 18