Create README.md

README.md

@@ -0,0 +1,14 @@
+---
+language: en
+datasets:
+ - scientific_papers
+ 
+license: apache-2.0
+---
+
+## Introduction
+
+[Allenai's Longformer Encoder-Decoder (LED)](https://github.com/allenai/longformer#longformer).
+
+This is the official *led-large-16384* checkpoint that is fine-tuned on the arXiv dataset.*led-large-16384-arxiv* is the official fine-tuned version of [led-large-16384](https://huggingface.co/allenai/led-large-16384). As presented in the [paper](https://arxiv.org/pdf/2004.05150.pdf), the checkpoint achieves state-of-the-art results on arxiv
+![model image](https://raw.githubusercontent.com/patrickvonplaten/scientific_images/master/led_arxiv_result.png)## Evaluation on downstream task[This notebook](https://colab.research.google.com/drive/12INTTR6n64TzS4RrXZxMSXfrOd9Xzamo?usp=sharing) shows how *led-large-16384-arxiv* can be evaluated on the [arxiv dataset](https://huggingface.co/datasets/scientific_papers