chrisjay's picture
added updates
cd48f69
|
raw
history blame
2.05 kB
metadata
license: apache-2.0
tags:
  - afro-digits-speech
datasets:
  - crowd-speech-africa
metrics:
  - accuracy
model-index:
  - name: afrospeech-wav2vec-ibo
    results:
      - task:
          name: Audio Classification
          type: audio-classification
        dataset:
          name: Afro Speech
          type: chrisjay/crowd-speech-africa
          args: 'no'
        metrics:
          - name: Validation Accuracy
            type: accuracy
            value: 1

afrospeech-wav2vec-ibo

This model is a fine-tuned version of facebook/wav2vec2-base on the crowd-speech-africa, which was a crowd-sourced dataset collected using the afro-speech Space. It achieves the following results on the validation set:

  • F1: 1.0
  • Accuracy: 1.0

The confusion matrix below helps to give a better look at the model's performance across the digits. Through it, we can see the precision and recall of the model as well as other important insights.

confusion matrix

Training and evaluation data

The model was trained on a mixed audio data from Igbo (ibo).

  • Size of training set: 109
  • Size of validation set: 28

Below is a distribution of the dataset (training and valdation)

digits-bar-plot-for-afrospeech

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 3e-05
  • train_batch_size: 64
  • eval_batch_size: 64
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • num_epochs: 150

Training results

Training Loss Epoch Validation Accuracy
0.1415 1 1.0
0.0241 50 1.0
0.0019 100 0.929
0.0012 150 0.892

Framework versions

  • Transformers 4.21.3
  • Pytorch 1.12.0
  • Datasets 1.14.0
  • Tokenizers 0.12.1