Scandinavian XLM-RoBERTa (base-sized model)

This model is currently being created. Do not use yet.

Adjusting down lr from 1e4 to 5e5 since we have some instability. Restarting Nov 6. Training only 500k steps.

Downloads last month: 6

Inference Examples

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.