metadata
language: en
datasets:
- timit_asr
tags:
- audio
- automatic-speech-recognition
license: apache-2.0
widget:
- label: Sample 1 (from LibriSpeech)
src: https://cdn-media.huggingface.co/speech_samples/sample1.flac
Wav2Vec2-Base-TIMIT
Fine-tuned facebook/wav2vec2-base on the timit_asr dataset. When using this model, make sure that your speech input is sampled at 16kHz.
Usage
The model can be used directly (without a language model) as follows:
import torch
from datasets import load_dataset
import soundfile as sf
from transformers import Wav2Vec2ForCTC, Wav2Vec2Processor
model_name = "elgeish/wav2vec2-base-timit"
processor = Wav2Vec2Processor.from_pretrained(model_name, do_lower_case=True)
model = Wav2Vec2ForCTC.from_pretrained(model_name)
dataset = load_dataset("timit_asr", split="test[:10]")
def prepare_example(example):
example["speech"], _ = sf.read(example["file"])
return example
dataset = dataset.map(prepare_example, remove_columns=["file"])
inputs = processor(dataset["speech"], sampling_rate=16000, return_tensors="pt", padding="longest")
with torch.no_grad():
predicted_ids = torch.argmax(model(inputs.input_values).logits, dim=-1)
predicted_transcripts = processor.tokenizer.batch_decode(predicted_ids)
for reference, predicted in zip(dataset["text"], predicted_transcripts):
print("reference:", reference)
print("predicted:", predicted)
print("--")
Here's the output:
reference: The bungalow was pleasantly situated near the shore.
predicted: the bunglow was plesntly situated near the shor
--
reference: Don't ask me to carry an oily rag like that.
predicted: don't ask me to carry an oily rag like that
--
reference: Are you looking for employment?
predicted: are you oking for employment
--
reference: She had your dark suit in greasy wash water all year.
predicted: she had your dark suit in greasy wash water all year
--
reference: At twilight on the twelfth day we'll have Chablis.
predicted: at twilight on the twelfth day we'll have shiple
--
reference: Eating spinach nightly increases strength miraculously.
predicted: eating spanage nightly increases strength moraculously
--
reference: Got a heck of a buy on this, dirt cheap.
predicted: got a heck of a by on this dert cheep
--
reference: The scalloped edge is particularly appealing.
predicted: the scaliped edge iuse particularly appeling
--
reference: A big goat idly ambled through the farmyard.
predicted: a big goat idely ambled through the farmyard
--
reference: This group is secularist and their program tends to be technological.
predicted: this croup is secularist and their program tens to be technological
--
Fine-Tuning Script
You can find the script used to produce this model here.