Edit model card

iati-drr-classifier

This model is a fine-tuned version of alex-miller/ODABert on a subset of the alex-miller/iati-policy-markers dataset. It achieves the following results on the evaluation set:

  • Loss: 0.3910
  • Accuracy: 0.8207

Model description

This model has been trained to identify disaster risk reduction (DRR) project titles and/or descriptions. It returns "0" for projects with no DRR component, and "1" for projects with DRR as a principal or significant objective.

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Code to subset the dataset and train the model is available here.

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-06
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 4

Training results

Training Loss Epoch Step Validation Loss Accuracy
0.607 1.0 508 0.5053 0.7507
0.4569 2.0 1016 0.4289 0.7980
0.4011 3.0 1524 0.4009 0.8143
0.3786 4.0 2032 0.3910 0.8207

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.2.1+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2
Downloads last month
13
Safetensors
Model size
168M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for alex-miller/iati-drr-classifier

Finetuned
(21)
this model

Dataset used to train alex-miller/iati-drr-classifier