Hugging Face's logo

ignos
/
Mistral-T5-7B-v1

Text Generation
Transformers
PyTorch
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
3
Mistral-T5-7B-v1
File size: 997 Bytes 
a1248e5
 
 
e91dcc4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
 
---
license: apache-2.0
---

# Model Card for Model ID

  This model is a finetuning of [Toten5/Marcoroni-neural-chat-7B-v2](https://huggingface.co/Toten5/Marcoroni-neural-chat-7B-v2)
    
## Model Details

### Model Description

- **Developed by:** Ignos
- **Model type:** Mistral
- **License:** Apache-2.0

## Uses

  Model created to improve instructional behavior.

## Bias, Risks, and Limitations

  The same bias, risks and limitations from base models.

## Training Details

### Training Data

- [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca)

### Training Procedure

- Training with QLoRA approach and merging with base model.

### Results

- Huggingface evaluation pending

#### Summary

## Technical Specifications

### Model Architecture and Objective

- Models based on Mistral Architecture

### Compute Infrastructure

- Training on RunPod

#### Hardware

- 3 x RTX 4090
- 48 vCPU 377 GB RAM

#### Software

- Axolotl 0.3.0

### Framework versions

- PEFT 0.6.0