File size: 468 Bytes
f040f5f 0ee8c18 e8dab99 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: mit
datasets:
- databricks/databricks-dolly-15k
language:
- en
library_name: adapter-transformers
pipeline_tag: text-generation
---
# Model Card for TarsDolly
## Model Details
TarsDolly is FT on HuggingFaceH4/zephyr-7b-alpha using Dolly-15k dataset for general chat.
#### Preprocessing
Dolly-15k dataset was converted into chatml style for futher FT on zephyr-7b-beta model
#### Training Hyperparameters
epochs 4
batch_size 1
block_size 2096
lr 2e-4 |