Update README.md

README.md

@@ -68,6 +68,7 @@ This repository has the [source code](https://github.com/Nkluge-correa/TeenyTiny
 - [Tokenizers](https://github.com/huggingface/tokenizers)
 - [Sentencepiece](https://github.com/google/sentencepiece)
 - [Accelerate](https://github.com/huggingface/accelerate)
+- [FlashAttention](https://github.com/Dao-AILab/flash-attention)
 - [Codecarbon](https://github.com/mlco2/codecarbon)
 - [AutoAWQ](https://github.com/casper-hansen/AutoAWQ)
 
@@ -185,9 +186,7 @@ for i, completion in enumerate(completions):
 | 1,000,000 | 2.50            | 12.27      | 96.19 kWh                | 34.18 KgCO2eq |
 | 1,100,000 | 2.48            | 11.96      | 106.06 kWh               | 37.70 KgCO2eq |
 | 1,200,000 | 2.46            | 11.77      | 115.69 kWh               | 41.11 KgCO2eq |
-
-- Note: Each evaluation consumed around 0.26 kWh of energy (~ 0.09 KgCO2eq), totaling 3.12 kWh (~ 1,11
-KgCO2eq).
+| 1,300,000 | 2.50            | 12.20      | 125.49 kWh               | 44,59 KgCO2eq |
 
 ## Benchmarks
 
@@ -202,8 +201,8 @@ Evaluations on benchmarks were performed using the [Language Model Evaluation Ha
 | [OPT-350m](https://huggingface.co/facebook/opt-350m)                                | 31.78   | 23.55*                                  | 36.73*                                        | 26.02*                                   | 40.83*                                         |
 | [TeenyTinyLlama-160m](https://huggingface.co/nicholasKluge/TeenyTinyLlama-160m)     | 31.16   | 26.15                                   | 29.29                                         | 28.11                                    | 41.12                                          |
 | [Pythia-160m](https://huggingface.co/EleutherAI/pythia-160m-deduped)                | 31.16   | 24.06*                                  | 31.39*                                        | 24.86*                                   | 44.34*                                         |
-| [OPT-125m](https://huggingface.co/facebook/opt-125m)                                | 30.80   | 22.87                                   | 31.47                                         | 26.02                                    | 42.87                                          |
-| [Gpt2-portuguese-small](https://huggingface.co/pierreguillou/gpt2-small-portuguese) | 30.22   | 22.48*                                  | 29.62*                                        | 27.36*                                   | 41.44*                                         |
+| [OPT-125m](https://huggingface.co/facebook/opt-125m)                                | 30.80   | 22.87*                                  | 31.47*                                        | 26.02*                                   | 42.87*                                         |
+| [GPortuguese-2](https://huggingface.co/pierreguillou/gpt2-small-portuguese)         | 30.22   | 22.48                                   | 29.62                                         | 27.36                                    | 41.44                                          |
 | [Gpt2-small](https://huggingface.co/gpt2)                                           | 29.97   | 21.48*                                  | 31.60*                                        | 25.79*                                   | 40.65*                                         | 
 | [Multilingual GPT](https://huggingface.co/ai-forever/mGPT)                          | 29.45   | 24.79                                   | 26.37*                                        | 25.17*                                   | 41.50                                          |
 
@@ -215,7 +214,6 @@ Evaluations on benchmarks were performed using the [Language Model Evaluation Ha
 | [Bert-base-portuguese-cased](https://huggingface.co/neuralmind/bert-base-portuguese-cased)  | 91.64   | 92.22                                                      | 93.07                                                               | 91.28                                                       | 87.45                                            | 94.19                                                            |
 | [TeenyTinyLlama-460m](https://huggingface.co/nicholasKluge/TeenyTinyLlama-460m)             | 91.19   | 91.64                                                      | 91.18                                                               | 92.28                                                       | 86.43                                            | 94.42                                                            |
 | [TeenyTinyLlama-160m](https://huggingface.co/nicholasKluge/TeenyTinyLlama-160m)             | 90.33   | 91.14                                                      | 90.00                                                               | 90.71                                                       | 85.78                                            | 94.05                                                            |
-| [Gpt2-small-portuguese](https://huggingface.co/pierreguillou/gpt2-small-portuguese)         | 89.13   | 91.60                                                      | 86.46                                                               | 87.42                                                       | 86.11                                            | 94.07                                                            |
 
 ## Cite as 🤗