Update README.md

README.md

@@ -12,12 +12,28 @@ thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
 
 This checkpoint should be loaded into `BartForConditionalGeneration.from_pretrained`. See the [BART docs](https://huggingface.co/transformers/model_doc/bart.html?#transformers.BartForConditionalGeneration) for more information.
 
----
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 4
+- eval_batch_size: 4
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 1
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:-------:|:---------:|:-------:|
+| 1.2875        | 1.0   | 5754 | 1.6294          | 11.009 | 7.4618 | 10.5573 | 10.8087   | 58.3382 |
 
-### Metrics for DistilBART models
 
-| Model Name                       |   MM Params |   Inference Time (MS) |   Speedup |   Rouge 1 |   Rouge-L |
-|:---------------------------------|------------:|----------------------:|----------:|----------:|----------:|
-| distilbart-cnn-12-6-amazonreviews|         306 |                   137 |      1.68 |     10.557|     33.37 |
+### Framework versions
 
----
+- Transformers 4.19.2
+- Pytorch 1.11.0+cu113
+- Datasets 2.2.2
+- Tokenizers 0.12.1