exl2 quant (measurement.json in main branch)
check revisions for quants
A model trained on a dataset of 1.35 million rows of Yahoo Answers Q and A. ( https://huggingface.co/datasets/community-datasets/yahoo_answers_topics ) It does not chat well and will fall apart at longer contexts, but it does give unique responses. It also believes the year is 2006... so yea, have fun!
Model uses ChatML formatting and works "best" with single round QA. System prompt is "You are a helpful assistant."
