|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- teknium/OpenHermes-2.5 |
|
language: |
|
- en |
|
--- |
|
**This is a safetensors formated version of [EleutherAI/Hermes-RWKV-v5-7B](https://huggingface.co/EleutherAI/Hermes-RWKV-v5-7B) for use in [ai00](https://github.com/cgisky1980/ai00_rwkv_server) or [rwkv-runner](https://github.com/josStorer/RWKV-Runner)** |
|
|
|
This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset. |
|
|
|
The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer. |
|
|
|
An example interaction: |
|
``` |
|
\x16user |
|
Write a poem about the beauty of mathematics in the style of Emily Dickinson.\x17 |
|
\x16assistant |
|
In the heart of Numbers, so precise, |
|
A Beauty dwells - both cool and nice. |
|
An elegance that sings in sums, |
|
And dances to algebraic drums. |
|
|
|
Addition's grace, subtraction's might, |
|
Multiplication's sheer delight, |
|
Division's firm yet gentle hand, |
|
All part of this enchanted land. |
|
|
|
Infinity, a lover bold, |
|
To whom the stars their secrets told, |
|
While Zero, cloaked in mystery, |
|
Unlocks each mathematical decree. |
|
|
|
Fractals bloom like flowers wild, |
|
Geometry, Nature's favored child, |
|
Calculus, with steady gaze, |
|
Maps out life's intricate maze. |
|
|
|
Pi, an endless serenade, |
|
In circles' arms forever laid, |
|
And prime numbers, |
|
standing lone, |
|
Make the universe their own. |
|
|
|
Each equation, theorem scribed, |
|
In |
|
parchment old or computer imbibed, |
|
Is but a whisper from the skies, |
|
A cosmic truth in disguise.\x17 |
|
``` |
|
In the above, newlines are printed without escaping, while ASCII codes are escaped for readability. |
