metadata

license: apache-2.0
tags:
  - generated_from_keras_callback
model-index:
  - name: Rocketknight1/distilbert-base-uncased-finetuned-squad
    results: []

Rocketknight1/distilbert-base-uncased-finetuned-squad

This model is a fine-tuned version of distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 0.9657
Train End Logits Sparse Categorical Accuracy: 0.7324
Train Start Logits Sparse Categorical Accuracy: 0.6940
Validation Loss: 1.1216
Validation End Logits Sparse Categorical Accuracy: 0.6979
Validation Start Logits Sparse Categorical Accuracy: 0.6642
Epoch: 1

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 11064, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Train End Logits Sparse Categorical Accuracy	Train Start Logits Sparse Categorical Accuracy	Validation Loss	Validation End Logits Sparse Categorical Accuracy	Validation Start Logits Sparse Categorical Accuracy	Epoch
1.4605	0.6170	0.5768	1.1588	0.6840	0.6511	0
0.9657	0.7324	0.6940	1.1216	0.6979	0.6642	1

Framework versions

Transformers 4.19.0.dev0
TensorFlow 2.8.0-rc0
Datasets 2.1.1.dev0
Tokenizers 0.11.0