README.md

---
license: apache-2.0
datasets:
- PygmalionAI/PIPPA
- larryvrh/PIPPA-TavernFormat
- Norquinal/claude_multiround_chat_30k
- Norquinal/claude_evol_instruct_100k
- ehartford/dolphin
---


## RWKV 1.5B  for android and iOS 

focus on Role play

<strike>should wait for RWKV runner updated to test this model, this model need select customized vocabs file</strike>
Runner have updated to be able using selected tokenzier files

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/c25oCUHJDm02WYnZkfZZP.png)

use following txt file to inference and 

https://huggingface.co/xiaol/RWKV-claude-for-mobile-v4-world-1.5B-16k/blob/main/rwkv_vocab_v20230424.txt

and use preset to change names to user and assistant which finetuned with this start prefix format
details in this image:

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/mpa2FGe9y2PqCQqm_Y3S3.png)


more detail here:https://huggingface.co/xiaol/RWKV-paper-reviewer-and-reading-comprehension-wenda-Worldv4-7B-16k


## or you can directly use it on phone make it as your own assistant
https://github.com/daquexian/faster-rwkv



![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/COgG_wLSNZo5DK8TGeFbV.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/gOMzvN6N5vMeU2mIv4IdA.png)

temp 0.7 topp 0.4
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/QWOn-6JysAis7z7Kr84o-.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/tXPJYIYQHhBQxIqs7iwcu.png)

## Training details


![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/LzT5YE00j5_Sa6nlmpf09.png)