Update README.md

README.md

@@ -1,42 +1,345 @@
 ---
 license: mit
 base_model: camembert-base
-tags:
-- generated_from_trainer
 metrics:
 - precision
 - recall
 - f1
 - accuracy
 model-index:
-- name: camembert-base-frenchNER_4entities
+- name: Camembert-base-frenchNER_4entities
   results: []
+datasets:
+- CATIE-AQ/frenchNER_4entities
+language:
+- fr
+widget:
+- text: "Assurés de disputer l'Euro 2024 en Allemagne l'été prochain (du 14 juin au 14 juillet) depuis leur victoire aux Pays-Bas, les Bleus ont fait le nécessaire pour avoir des certitudes. Avec six victoires en six matchs officiels et un seul but encaissé, Didier Deschamps a consolidé les acquis de la dernière Coupe du monde. Les joueurs clés sont connus : Kylian Mbappé, Aurélien Tchouameni, Antoine Griezmann, Ibrahima Konaté ou encore Mike Maignan."
+library_name: transformers
+pipeline_tag: token-classification
+co2_eq_emissions: 35
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
 
-# camembert-base-frenchNER_4entities
+# Camembert-base-frenchNER_3entities
 
-This model is a fine-tuned version of [camembert-base](https://huggingface.co/camembert-base) on an unknown dataset.
-It achieves the following results on the evaluation set:
-- Loss: 0.0542
-- Precision: 0.9844
-- Recall: 0.9844
-- F1: 0.9844
-- Accuracy: 0.9844
+## Model Description
 
-## Model description
+We present **Camembert-base-frenchNER_4entities**, which is a [CamemBERT base](https://huggingface.co/camembert-base) fine-tuned for the Name Entity Recognition task for the French language on four French NER datasets for 4 entities (LOC, PER, ORG, MISC).  
+All these datasets were concatenated and cleaned into a single dataset that we called [frenchNER_4entities](https://huggingface.co/datasets/CATIE-AQ/frenchNER_4entities).  
+There are a total of **384,773** rows, of which **328,757** are for training, **24,131** for validation and **31,885** for testing.
+Our methodology is described in a blog post available in [English](https://blog.vaniila.ai/en/NER_en/) or [French](https://blog.vaniila.ai/NER/).
 
-More information needed
 
-## Intended uses & limitations
 
-More information needed
+## Dataset
 
-## Training and evaluation data
+The dataset used is [frenchNER](https://huggingface.co/datasets/CATIE-AQ/frenchNER_4entities), which represents ~385k sentences labeled in 4 categories :
+* PER: personality ;
+* LOC: location ;
+* ORG: organization ;
+* MISC: miscellaneous  ;
+* O: background (Outside entity).
+
+The distribution of the entities is as follows:
+
+<table>
+<thead>
+  <tr>
+    <th><br>Splits</th>
+    <th><br>O</th>
+    <th><br>PER</th>
+    <th><br>LOC</th>  
+    <th><br>ORG</th>
+    <th><br>MISC</th>
+  </tr>
+</thead>
+<tbody>
+    <td><br>train</td>
+    <td><br><b>A</b></td>
+    <td><br><b>B</b></td>
+    <td><br><b>C</b></td>
+    <td><br><b>D</b></td>
+    <td><br><b>E</b></td>
+  </tr>
+  <tr>
+    <td><br>validation</td>
+    <td><br><b>A</b></td>
+    <td><br><b>B</b></td>
+    <td><br><b>C</b></td>
+    <td><br><b>D</b></td>
+    <td><br><b>E</b></td>
+  </tr>
+  <tr>
+    <td><br>test</td>
+    <td><br><b>A</b></td>
+    <td><br><b>B</b></td>
+    <td><br><b>C</b></td>
+    <td><br><b>D</b></td>
+    <td><br><b>E</b></td>
+  </tr>
+</tbody>
+</table>
+
+
+## Evaluation results
+
+The evaluation was carried out using the [**evaluate**](https://pypi.org/project/evaluate/) python package.
+
+### frenchNER_4entities
+
+<table>
+<thead>
+    <tr>
+      <th><br>Model</th>
+      <th><br>Metrics</th>
+      <th><br>PER</th>
+      <th><br>LOC</th>
+      <th><br>ORG</th>
+      <th><br>MISC</th>
+      <th><br>O</th>
+      <th><br>Overall</th>
+    </tr>
+</thead>
+<tbody>
+    <tr>
+        <td rowspan="3"><br>Camembert-base-frenchNER_4entities</td>
+        <td><br>Precision</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td><br>Recall</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td>F1</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td></td>
+        <td><br>Number</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+</tbody>
+</table>
+
+
+In detail:
+
+### multiconer
+
+<table>
+<thead>
+    <tr>
+      <th><br>Model</th>
+      <th><br>Metrics</th>
+      <th><br>PER</th>
+      <th><br>LOC</th>
+      <th><br>ORG</th>
+      <th><br>MISC</th>
+      <th><br>O</th>
+      <th><br>Overall</th>
+    </tr>
+</thead>
+<tbody>
+    <tr>
+        <td rowspan="3"><br>Camembert-base-frenchNER_4entities</td>
+        <td><br>Precision</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td><br>Recall</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td>F1</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td></td>
+        <td><br>Number</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+</tbody>
+</table>
+
+### multinerd
+
+<table>
+<thead>
+    <tr>
+      <th><br>Model</th>
+      <th><br>Metrics</th>
+      <th><br>PER</th>
+      <th><br>LOC</th>
+      <th><br>ORG</th>
+      <th><br>MISC</th>
+      <th><br>O</th>
+      <th><br>Overall</th>
+    </tr>
+</thead>
+<tbody>
+    <tr>
+        <td rowspan="3"><br>Camembert-base-frenchNER_4entities</td>
+        <td><br>Precision</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td><br>Recall</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td>F1</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td></td>
+        <td><br>Number</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+</tbody>
+</table>
+
+
+### wikiner
+
+<table>
+<thead>
+    <tr>
+      <th><br>Model</th>
+      <th><br>Metrics</th>
+      <th><br>PER</th>
+      <th><br>LOC</th>
+      <th><br>ORG</th>
+      <th><br>MISC</th>
+      <th><br>O</th>
+      <th><br>Overall</th>
+    </tr>
+</thead>
+<tbody>
+    <tr>
+        <td rowspan="3"><br>Camembert-base-frenchNER_4entities</td>
+        <td><br>Precision</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td><br>Recall</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td>F1</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+    <tr>
+        <td></td>
+        <td><br>Number</td>
+        <td><br>A</td>
+        <td><br>B</td>
+        <td><br>C</td>
+        <td><br>D</td>
+        <td><br>E</td>
+        <td><br>F</td>
+    </tr>
+</tbody>
+</table>
+
+
+## Usage
+### Code
+
+```python
+from transformers import pipeline
+
+ner = pipeline('question-answering', model='CATIE-AQ/Camembert-base-frenchNER_4entities', tokenizer='CATIE-AQ/Camembert-base-frenchNER_4entities', grouped_entities=True)
+
+result = ner(
+"Assurés de disputer l'Euro 2024 en Allemagne l'été prochain (du 14 juin au 14 juillet) depuis leur victoire aux Pays-Bas, les Bleus ont fait le nécessaire pour avoir des certitudes. Avec six victoires en six matchs officiels et un seul but encaissé, Didier Deschamps a consolidé les acquis de la dernière Coupe du monde. Les joueurs clés sont connus : Kylian Mbappé, Aurélien Tchouameni, Antoine Griezmann, Ibrahima Konaté ou encore Mike Maignan."
+)
+
+print(result)
+```
+```python
+
+```
+
+### Try it through Space
+A Space has been created to test the model. It is available [here](https://huggingface.co/spaces/CATIE-AQ/Camembert-NER).
 
-More information needed
 
 ## Training procedure
 
@@ -66,3 +369,93 @@ The following hyperparameters were used during training:
 - Pytorch 2.1.2
 - Datasets 2.16.1
 - Tokenizers 0.15.0
+
+
+## Environmental Impact
+
+*Carbon emissions were estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). The hardware, runtime, cloud provider, and compute region were utilized to estimate the carbon impact.*
+
+- **Hardware Type:** A100 PCIe 40/80GB
+- **Hours used:** 1h45min
+- **Cloud Provider:** Private Infrastructure
+- **Carbon Efficiency (kg/kWh):** 0.046 (estimated from [electricitymaps](https://app.electricitymaps.com/zone/FR) for the day of January 4, 2024.)
+- **Carbon Emitted** *(Power consumption x Time x Carbon produced based on location of power grid)*: 0.02 kg eq. CO2
+
+
+
+## Citations
+
+### Camembert-frenchNER_4entities
+```
+TODO
+```
+
+### multiconer
+
+> @inproceedings{multiconer2-report,  
+    title={{SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)}},  
+    author={Fetahu, Besnik and Kar, Sudipta and Chen, Zhiyu and Rokhlenko, Oleg and Malmasi, Shervin},  
+    booktitle={Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)},  
+    year={2023},  
+    publisher={Association for Computational Linguistics}}
+
+> @article{multiconer2-data,  
+    title={{MultiCoNER v2: a Large Multilingual dataset for Fine-grained and Noisy Named Entity Recognition}},  
+    author={Fetahu, Besnik and Chen, Zhiyu and Kar, Sudipta and Rokhlenko, Oleg and Malmasi, Shervin},  
+    year={2023}}
+
+
+### multinerd
+
+> @inproceedings{tedeschi-navigli-2022-multinerd,  
+    title = "{M}ulti{NERD}: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguation)",  
+    author = "Tedeschi, Simone and  Navigli, Roberto",  
+    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2022",  
+    month = jul,  
+    year = "2022",  
+    address = "Seattle, United States",  
+    publisher = "Association for Computational Linguistics",  
+    url = "https://aclanthology.org/2022.findings-naacl.60",  
+    doi = "10.18653/v1/2022.findings-naacl.60",  
+    pages = "801--812"}
+
+### pii-masking-200k
+
+> @misc {ai4privacy_2023,  
+author = { {ai4Privacy} },  
+title = { pii-masking-200k (Revision 1d4c0a1) },  
+year = 2023,  
+url = { https://huggingface.co/datasets/ai4privacy/pii-masking-200k },  
+doi = { 10.57967/hf/1532 },  
+publisher = { Hugging Face }}
+
+### wikiner
+
+> @article{NOTHMAN2013151,  
+title = {Learning multilingual named entity recognition from Wikipedia},  
+journal = {Artificial Intelligence},  
+volume = {194},  
+pages = {151-175},  
+year = {2013},  
+note = {Artificial Intelligence, Wikipedia and Semi-Structured Resources},  
+issn = {0004-3702},  
+doi = {https://doi.org/10.1016/j.artint.2012.03.006},  
+url = {https://www.sciencedirect.com/science/article/pii/S0004370212000276},  
+author = {Joel Nothman and Nicky Ringland and Will Radford and Tara Murphy and James R. Curran}}
+
+
+### frenchNER_4entities
+```
+TODO
+```
+
+### CamemBERT
+> @inproceedings{martin2020camembert,  
+  title={CamemBERT: a Tasty French Language Model},  
+  author={Martin, Louis and Muller, Benjamin and Su{\'a}rez, Pedro Javier Ortiz and Dupont, Yoann and Romary, Laurent and de la Clergerie, {\'E}ric Villemonte and Seddah, Djam{\'e} and Sagot, Beno{\^\i}t},  
+  booktitle={Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},  
+  year={2020}}
+
+
+## License
+ [cc-by-4.0](https://creativecommons.org/licenses/by/4.0/deed.en)