mdeberta-v3-base-nubes

This model is a finetuned version of mdeberta-v3-base for the nubes dataset used in a benchmark in the paper TODO. The model has a F1 of 0.919

Please refer to the original publication for more information TODO LINK

Parameters used

parameter	Value
batch size	32
learning rate	3e-05
classifier dropout	0
warmup ratio	0
warmup steps	0
weight decay	0
optimizer	AdamW
epochs	10
early stopping patience	3

BibTeX entry and citation info

TODO

Downloads last month: 19

Safetensors

Model size

279M params

Tensor type

I64

F32

Inference Examples

Token Classification

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including IIC/mdeberta-v3-base-nubes

👨🏻‍⚕️ Spanish Clinical Encoders Analysis

Collection

Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks` • 92 items • Updated Jan 23 • 1

Evaluation results

f1 on nubes
test set self-reported

0.919

View on Papers With Code