Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
AkimfromParis
commited on
Update full datasets description in About V1.3 by Akim
Browse files- src/about.py +3 -10
src/about.py
CHANGED
@@ -77,11 +77,9 @@ TITLE = """<h1 align="center" id="space-title">Open Japanese LLM Leaderboard by
|
|
77 |
INTRODUCTION_TEXT = """
|
78 |
🇯🇵 The Open Japanese LLM Leaderboard 🌸 by [LLM-Jp](https://llm-jp.nii.ac.jp/en/) evaluates the performance of Japanese Large Language Models (LLMs).
|
79 |
|
80 |
-
This leaderboard was built by [LLM-Jp](https://llm-jp.nii.ac.jp/en/), a cross-organizational project for the research and development of Japanese large language models (LLMs). Organized by the National Institute of Informatics, LLM-jp aims to develop open-source and strong Japanese LLMs
|
81 |
|
82 |
-
|
83 |
-
|
84 |
-
For more information about benchmarks, and datasets, please consult the "About" page. For more details, please refer to the website of [LLM-Jp](https://llm-jp.nii.ac.jp/en/)
|
85 |
|
86 |
"""
|
87 |
|
@@ -129,12 +127,7 @@ LLM_BENCHMARKS_TEXT = f"""
|
|
129 |
**FA (Fundamental Analysis)**
|
130 |
|
131 |
* `Wikipedia Annotated Corpus`, [Source](https://github.com/ku-nlp/WikipediaAnnotatedCorpus) (License CC BY-SA 4.0)
|
132 |
-
List of tasks:
|
133 |
-
- Reading Prediction
|
134 |
-
- Named-entity recognition (NER)
|
135 |
-
- Dependency Parsing
|
136 |
-
- Predicate-argument structure analysis (PAS)
|
137 |
-
- Coreference Resolution
|
138 |
|
139 |
**MR (Mathematical Reasoning)**
|
140 |
|
|
|
77 |
INTRODUCTION_TEXT = """
|
78 |
🇯🇵 The Open Japanese LLM Leaderboard 🌸 by [LLM-Jp](https://llm-jp.nii.ac.jp/en/) evaluates the performance of Japanese Large Language Models (LLMs).
|
79 |
|
80 |
+
This leaderboard was built by contributors of [LLM-Jp](https://llm-jp.nii.ac.jp/en/), a cross-organizational project for the research and development of Japanese large language models (LLMs). Organized by the National Institute of Informatics, LLM-jp aims to develop open-source and strong Japanese LLMs with more than 1,500 participants from academia and industry as of July 2024.
|
81 |
|
82 |
+
This Open Japanese LLM Leaderboard assesses language understanding, of Japanese LLMs with more than 52 benchmarks from classical to modern NLP tasks such as Natural language inference, Question Answering, Machine Translation, Code Generation, Mathematical reasoning, Summarization, etc. When you submit a model on the "Submit here!" page, it is automatically evaluated on a set of benchmarks. For more information about benchmarks, please consult the "About" page. For more details, please refer to the website of [LLM-Jp](https://llm-jp.nii.ac.jp/en/)
|
|
|
|
|
83 |
|
84 |
"""
|
85 |
|
|
|
127 |
**FA (Fundamental Analysis)**
|
128 |
|
129 |
* `Wikipedia Annotated Corpus`, [Source](https://github.com/ku-nlp/WikipediaAnnotatedCorpus) (License CC BY-SA 4.0)
|
130 |
+
List of tasks: (Reading Prediction, Named-entity recognition (NER), Dependency Parsing, Predicate-argument structure analysis (PAS), Coreference Resolution)
|
|
|
|
|
|
|
|
|
|
|
131 |
|
132 |
**MR (Mathematical Reasoning)**
|
133 |
|