llm-jp/leaderboard-requests
Viewer
•
Updated
•
154
•
2.03k
•
1
LLM-jp
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
llm-jp's activity
t0-0
updated
3
datasets
about 2 hours ago
llm-jp-user
updated
a
dataset
about 12 hours ago
shintaro-ozaki
authored
4
papers
5 days ago
Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?
Paper
•
2410.03240
•
Published
BQA: Body Language Question Answering Dataset for Video Large Language Models
Paper
•
2410.13206
•
Published
Towards Cross-Lingual Explanation of Artwork in Large-scale Vision Language Models
Paper
•
2409.01584
•
Published
An Implementation of Werewolf Agent That does not Truly Trust LLMs
Paper
•
2409.01575
•
Published
AkimfromParis
posted
an
update
about 1 month ago
Post
1452
🇯🇵 The Open Japanese LLM Leaderboard created by LLM-jp 🌸 in partnership with HuggingFace 🤗 was released today!
Blog: https://huggingface.co/blog/leaderboard-japanese
Space: llm-jp/open-japanese-llm-leaderboard
🌍 The leaderboard is available in both Japanese and English
📚 Based on the evaluation tool, llm-jp-eval with more than 20 datasets for Japanese LLMs
📊 The leaderboard showcases all the metrics for NLP experts, plus averages for NLP beginners
💻 For the comfort of users, we chose a horizontal UI, and implemented it in a light and dark theme on Gradio
🔬 The radar chart provides a very interesting visualization of metrics!
🌱 We are using the Japanese research platform, MDX, so please be patient!
⚡ LLMs bigger than +70B will be evaluated soon…
How do you say “GPUs Go Brrr” in Japanese - > GPUがブンブン～! (To pronounce "GPU ga bunbun!") 🔥
Blog: https://huggingface.co/blog/leaderboard-japanese
Space: llm-jp/open-japanese-llm-leaderboard
🌍 The leaderboard is available in both Japanese and English
📚 Based on the evaluation tool, llm-jp-eval with more than 20 datasets for Japanese LLMs
📊 The leaderboard showcases all the metrics for NLP experts, plus averages for NLP beginners
💻 For the comfort of users, we chose a horizontal UI, and implemented it in a light and dark theme on Gradio
🔬 The radar chart provides a very interesting visualization of metrics!
🌱 We are using the Japanese research platform, MDX, so please be patient!
⚡ LLMs bigger than +70B will be evaluated soon…
How do you say “GPUs Go Brrr” in Japanese - > GPUがブンブン～! (To pronounce "GPU ga bunbun!") 🔥
-
- 4 replies
Taishi-N324
authored
a
paper
about 2 months ago
shtapm
authored
a
paper
about 2 months ago
AkimfromParis
posted
an
update
2 months ago
Post
618
Philosopher Gilles Deleuze in 1985-86 about society of control, probabilities, and power. Visionary words in an era of autoregressive models:
"The biopolitics of populations appears when right sets about administering life, says Foucault, administering life in any open multiplicities whatever. You see the importance of the difference between discipline and biopolitics. The one is in an open space, with large multiplicities to which limits are not assignable. They can only be treated by the calculus of probabilities, hence the development of the calculus of probabilities and the meaning [sens] of the social control of probabilities, the probabilities of marriage in a nation, the probabilities of mortality, probabilities of natality. Natality, nuptiality, mortality …
... When Foucault directly addresses the question of power, namely, one of his great theses: no, power does not repress, or it represses only secondarily. What does it do? It does something much more profound and, doubtless, more formidable that repressing: it forms, it shapes. It does not silence, it does worse: it makes speak. It disciplines, it standardizes [normalise]. But repression is entirely secondary in relation to the positive operations of power.
Power does not repress, it disciplines, it manages, it controls, it standardizes, etcetera. It does not silence, it makes speak. It does not prevent acting, it makes act."
From the Deleuze Seminars at Université Paris 8 translated by Purdue University -> https://deleuze.cla.purdue.edu/
"The biopolitics of populations appears when right sets about administering life, says Foucault, administering life in any open multiplicities whatever. You see the importance of the difference between discipline and biopolitics. The one is in an open space, with large multiplicities to which limits are not assignable. They can only be treated by the calculus of probabilities, hence the development of the calculus of probabilities and the meaning [sens] of the social control of probabilities, the probabilities of marriage in a nation, the probabilities of mortality, probabilities of natality. Natality, nuptiality, mortality …
... When Foucault directly addresses the question of power, namely, one of his great theses: no, power does not repress, or it represses only secondarily. What does it do? It does something much more profound and, doubtless, more formidable that repressing: it forms, it shapes. It does not silence, it does worse: it makes speak. It disciplines, it standardizes [normalise]. But repression is entirely secondary in relation to the positive operations of power.
Power does not repress, it disciplines, it manages, it controls, it standardizes, etcetera. It does not silence, it makes speak. It does not prevent acting, it makes act."
From the Deleuze Seminars at Université Paris 8 translated by Purdue University -> https://deleuze.cla.purdue.edu/
AkimfromParis
authored
a
paper
2 months ago
kazukifujii
authored
a
paper
5 months ago
shintaro-ozaki
authored
a
paper
5 months ago
kazukifujii
authored
3
papers
5 months ago
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities
Paper
•
2404.17790
•
Published
•
5
Heron-Bench: A Benchmark for Evaluating Vision Language Models in Japanese
Paper
•
2404.07824
•
Published
•
3
Building a Large Japanese Web Corpus for Large Language Models
Paper
•
2404.17733
•
Published
•
4
conglongli
authored
a
paper
5 months ago
Taishi-N324
authored
a
paper
5 months ago