Hugging Face's logo

fblgit
/
una-cybertron-7b-v3-OMA

Text Generation
Transformers
Safetensors
mistral
juanako
UNA
cybertron
xaberius
text-generation-inference
Inference Endpoints
Model card Files
una-cybertron-7b-v3-OMA
File size: 2,594 Bytes 
aeb389f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29c9ff0
aeb389f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
 
---
license: apache-2.0
datasets:
- fblgit/tree-of-knowledge
library_name: transformers
tags:
- juanako
- UNA
- cybertron
- xaberius
---

# Model Card for una-cybertron-7b-v3 (UNA: Uniform Neural Alignment)

**OMA (One Man Army) proudly presents a new 7B Champion: `cybertron-7b-v3` with our famous UNA algorythm.**

The model excels in mathematics, logic, reasoning, overall very smart. He can make a deep reasoning over the context and prompt, it gives the impression of not missing details around.

This seems to be possible:
* UNA models can be SFT again
* UNA models are easy to be used as Merge Base, place Cybertron in the fan-in and fan-out of the layering
* UNA models now includes a digital watermark

## Model Details

Adiestrated with UNA: Uniform Neural Alignment technique (paper going out soon). 
* What is **NOT** UNA? Its not a merged layers model. Is not SLERP or SLURP or similar.
* What **is** UNA? A formula & A technique to *TAME* models

### Model Description

- **Developed by:** [juanako.ai](https://juanako.ai)
- **Author:** [Xavier M.](xavi@juanako.ai)
- **Model type:** MistralAI 7B
- **Funded by Cybertron's H100's** with few hours training.

### Prompt
The model is very good, works well on almost any prompt but ChatML format and Alpaca System gets the best
```
<|im_start|>system
- You are a helpful assistant chatbot trained by MosaicML.
- You answer questions.
- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>
<|im_start|>user
Explain QKV<|im_end|>
<|im_start|>assistant
```
```
### Assistant: I am StableVicuna, a large language model created by CarperAI. I am here to chat!

### Human: Explain QKV
### Assistant:
```
```
[Round <|round|>]
问：Explain QKV
答：
```
```
[Round <|round|>]
Question：Explain QKV
Answer：
```
```
Question：Explain QKV
Answer：
```
Using Exllamav2_HF set alpha=2.5 for 16K Context

### Framework versions

- Transformers 4.35.0-UNA
- Pytorch 2.1.0
- Datasets 2.14.6
- Tokenizers 0.14.1

### Citations
    If you find Cybertron, Juanako or any of our models useful, specially if you use it for your big brand.. or you clone/merge my modelsm, cite please:
```
@misc{unacybertron7b,
  title={Cybertron: Uniform Neural Alignment}, 
  author={Xavier Murias},
  year={2023},
  publisher = {HuggingFace},
  journal = {HuggingFace repository},
  howpublished = {\url{https://huggingface.co/fblgit/una-cybertron-7b-v3-OMA}},
}
```