File size: 1,006 Bytes
e01b01b 1e7358d e01b01b 1e7358d 3d40bca e01b01b 1e7358d d349540 1e7358d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
language: en
tags:
- Transformers
license: apache-2.0
datasets:
- SMHD
- Schizophrenia Reddit
---
# SchizophreniaRoberta model
is a model initialized with [roberta-large](https://huggingface.co/roberta-large) and trained with Schizophrenia Reddit, a subset of [Self-Reported Mental Health Diagnoses (SMHD) dataset](https://arxiv.org/pdf/1806.05258.pdf) which consists of Reddit posts by patients with schizophrenia only or schizophrenia with other mental disorders and matched control. We follow the standard pretraining protocols of RoBERTa with [Huggingface’s Transformers library](https://github.com/huggingface/transformers).
## Usage Load the model via [Huggingface’s Transformers library](https://github.com/huggingface/transformers):
from transformers import AutoTokenizer,
AutoModel tokenizer = AutoTokenizer.from_pretrained("Amalq/schizophrenia-roberta-large")
model = AutoModel.from_pretrained("Amalq/schizophrenia-roberta-large")
Perplexity of this model is: 4.43 |