AkimfromParis commited on
Commit
8ad23c3
·
verified ·
1 Parent(s): 412b71f

Update full datasets description in About V1.3 by Akim

Browse files
Files changed (1) hide show
  1. src/about.py +3 -10
src/about.py CHANGED
@@ -77,11 +77,9 @@ TITLE = """<h1 align="center" id="space-title">Open Japanese LLM Leaderboard by
77
  INTRODUCTION_TEXT = """
78
  🇯🇵 The Open Japanese LLM Leaderboard 🌸 by [LLM-Jp](https://llm-jp.nii.ac.jp/en/) evaluates the performance of Japanese Large Language Models (LLMs).
79
 
80
- This leaderboard was built by [LLM-Jp](https://llm-jp.nii.ac.jp/en/), a cross-organizational project for the research and development of Japanese large language models (LLMs). Organized by the National Institute of Informatics, LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose.
81
 
82
- When you submit a model on the "Submit here!" page, it is automatically evaluated on a set of benchmarks.This Open Japanese LLM Leaderboard assesses language understanding, of Japanese LLMs with more than 52 benchmarks from classical to modern NLP tasks such as Natural language inference, Question Answering, Machine Translation, Code Generation, Mathematical reasoning, Summarization, etc.
83
-
84
- For more information about benchmarks, and datasets, please consult the "About" page. For more details, please refer to the website of [LLM-Jp](https://llm-jp.nii.ac.jp/en/)
85
 
86
  """
87
 
@@ -129,12 +127,7 @@ LLM_BENCHMARKS_TEXT = f"""
129
  **FA (Fundamental Analysis)**
130
 
131
  * `Wikipedia Annotated Corpus`, [Source](https://github.com/ku-nlp/WikipediaAnnotatedCorpus) (License CC BY-SA 4.0)
132
- List of tasks:
133
- - Reading Prediction
134
- - Named-entity recognition (NER)
135
- - Dependency Parsing
136
- - Predicate-argument structure analysis (PAS)
137
- - Coreference Resolution
138
 
139
  **MR (Mathematical Reasoning)**
140
 
 
77
  INTRODUCTION_TEXT = """
78
  🇯🇵 The Open Japanese LLM Leaderboard 🌸 by [LLM-Jp](https://llm-jp.nii.ac.jp/en/) evaluates the performance of Japanese Large Language Models (LLMs).
79
 
80
+ This leaderboard was built by contributors of [LLM-Jp](https://llm-jp.nii.ac.jp/en/), a cross-organizational project for the research and development of Japanese large language models (LLMs). Organized by the National Institute of Informatics, LLM-jp aims to develop open-source and strong Japanese LLMs with more than 1,500 participants from academia and industry as of July 2024.
81
 
82
+ This Open Japanese LLM Leaderboard assesses language understanding, of Japanese LLMs with more than 52 benchmarks from classical to modern NLP tasks such as Natural language inference, Question Answering, Machine Translation, Code Generation, Mathematical reasoning, Summarization, etc. When you submit a model on the "Submit here!" page, it is automatically evaluated on a set of benchmarks. For more information about benchmarks, please consult the "About" page. For more details, please refer to the website of [LLM-Jp](https://llm-jp.nii.ac.jp/en/)
 
 
83
 
84
  """
85
 
 
127
  **FA (Fundamental Analysis)**
128
 
129
  * `Wikipedia Annotated Corpus`, [Source](https://github.com/ku-nlp/WikipediaAnnotatedCorpus) (License CC BY-SA 4.0)
130
+ List of tasks: (Reading Prediction, Named-entity recognition (NER), Dependency Parsing, Predicate-argument structure analysis (PAS), Coreference Resolution)
 
 
 
 
 
131
 
132
  **MR (Mathematical Reasoning)**
133