XLM_R_Galen-socialdisner

This model is a finetuned version of XLM_R_Galen for the socialdisner dataset used in a benchmark in the paper TODO. The model has a F1 of 0.919

Please refer to the original publication for more information TODO LINK

Parameters used

parameter	Value
batch size	16
learning rate	4e-05
classifier dropout	0.1
warmup ratio	0
warmup steps	0
weight decay	0
optimizer	AdamW
epochs	10
early stopping patience	3

BibTeX entry and citation info

TODO

Downloads last month: 18

Safetensors

Model size

278M params

Tensor type

I64

F32

Inference Examples

Token Classification

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train IIC/XLM_R_Galen-socialdisner

Collection including IIC/XLM_R_Galen-socialdisner

👨🏻‍⚕️ Spanish Clinical Encoders Analysis

Collection

Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks` • 92 items • Updated Jan 23 • 1

Evaluation results

f1 on socialdisner
test set self-reported

0.919

View on Papers With Code