---
library_name: peft
base_model: mistralai/Mistral-7B-v0.1
license: mit
datasets:
- teknium/OpenHermes-2.5
---

# Model Card for Model ID

A SFT version on Mistral-7B-v0.1 using dataset teknium/OpenHermes-2.5

## Model Details

### Model Description

- **Developed by:** Kunlin Tan
- **Model type:** Transformers
- **License:** MIT
- **Finetuned from model:** mistralai/Mistral-7B-v0.1


## Uses

```python

from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

config = PeftConfig.from_pretrained("linlinlin/zephy_SFT_Hermes")
model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")
model = PeftModel.from_pretrained(model, "linlinlin/zephy_SFT_Hermes")
```




## Training Details

### Training Data

teknium/OpenHermes-2.5


## Technical Specifications

#### Hardware

RTX-4090

#### Software

Ubuntu 22.04


### Framework versions

- PEFT 0.9.0