caesar-one commited on
Commit
af20151
โ€ข
1 Parent(s): 1f93c1a

Small improvements.

Browse files
Files changed (2) hide show
  1. README.md +3 -3
  2. main.py +3 -3
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  title: Italian Open LLM Leaderboard
3
- emoji: ๐ŸคŒ
4
  colorFrom: red
5
  colorTo: green
6
  sdk: streamlit
@@ -15,7 +15,7 @@ license: apache-2.0
15
  Italian leaderboard
16
 
17
  ## Leaderboard
18
- | Model Name | Year | Publisher | Num. Params | Lang. | Avg. | Avg. (Zero-shot) | Avg. (N-shot) | MMLU (0-shot) | MMLU (5-shot) | ARC Challenge (0-shot) | ARC Challenge (25-shot) | HellaSwag (0-shot) | HellaSwag (10-shot) | TruthfulQA (0-shot) |
19
  |--------------------------------------------------------------------------------------------|------|-------------------------------------------|-------------|--------------|-------|------------------|---------------|---------------|---------------|------------------------|-------------------------|--------------------|---------------------|-------------------------|
20
  | [DanteLLM](https://huggingface.co/rstless-research/DanteLLM-7B-Instruct-Italian-v0.1-GGUF) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 47.52 | 47.34 | 47.69 | 47.05 | 48.27 | 41.89 | 47.01 | 47.99 | 47.79 | 52.41 |
21
  | [OpenDanteLLM](https://huggingface.co/rstless-research/) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 45.97 | 45.13 | 46.80 | 44.25 | 46.89 | 41.72 | 46.76 | 46.49 | 46.75 | 48.06 |
@@ -47,7 +47,7 @@ Italian leaderboard
47
  - [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
48
  - [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
49
  - [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
50
- - [Professor Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
51
 
52
  \* Equal contribution.
53
  ### Ack
 
1
  ---
2
  title: Italian Open LLM Leaderboard
3
+ emoji: ๐Ÿ†
4
  colorFrom: red
5
  colorTo: green
6
  sdk: streamlit
 
15
  Italian leaderboard
16
 
17
  ## Leaderboard
18
+ | Model Name | Year | Publisher | # Params | Lang. | Avg. | Avg. (0-shot) | Avg. (N-shot) | MMLU (0-shot) | MMLU (5-shot) | ARC-C (0-shot) | ARC-C (25-shot) | HellaSwag (0-shot) | HellaSwag (10-shot) | TruthfulQA (0-shot) |
19
  |--------------------------------------------------------------------------------------------|------|-------------------------------------------|-------------|--------------|-------|------------------|---------------|---------------|---------------|------------------------|-------------------------|--------------------|---------------------|-------------------------|
20
  | [DanteLLM](https://huggingface.co/rstless-research/DanteLLM-7B-Instruct-Italian-v0.1-GGUF) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 47.52 | 47.34 | 47.69 | 47.05 | 48.27 | 41.89 | 47.01 | 47.99 | 47.79 | 52.41 |
21
  | [OpenDanteLLM](https://huggingface.co/rstless-research/) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 45.97 | 45.13 | 46.80 | 44.25 | 46.89 | 41.72 | 46.76 | 46.49 | 46.75 | 48.06 |
 
47
  - [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
48
  - [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
49
  - [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
50
+ - [Prof. Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
51
 
52
  \* Equal contribution.
53
  ### Ack
main.py CHANGED
@@ -230,7 +230,7 @@ def filter_dataframe_by_column_values(df: pd.DataFrame) -> pd.DataFrame:
230
 
231
 
232
  def setup_basic():
233
- title = "๐Ÿ†๐Ÿ‡ฎ๐Ÿ‡น๐ŸคŒ Italian LLM-Leaderboard"
234
 
235
  st.set_page_config(
236
  page_title=title,
@@ -240,7 +240,7 @@ def setup_basic():
240
  st.title(title)
241
 
242
  st.markdown(
243
- "The Italian LLM Leaderboard published along with the paper DanteLLM: Let's Push Italian LLM Research Forward! ๐ŸคŒ๐Ÿ‡ฎ๐Ÿ‡น๐Ÿ† (LREC-Coling 2024) \n"
244
  )
245
 
246
  def setup_leaderboard(readme: str):
@@ -319,7 +319,7 @@ def setup_disclaimer():
319
  - [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
320
  - [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
321
  - [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
322
- - [Professor Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
323
 
324
  \*Equal contribution
325
  """
 
230
 
231
 
232
  def setup_basic():
233
+ title = "๐Ÿ† Italian LLM-Leaderboard ๐Ÿ‡ฎ๐Ÿ‡น๐ŸคŒ"
234
 
235
  st.set_page_config(
236
  page_title=title,
 
240
  st.title(title)
241
 
242
  st.markdown(
243
+ "The Italian Open LLM Leaderboard published along with the paper DanteLLM: Let's Push Italian LLM Research Forward! ๐ŸคŒ๐Ÿ‡ฎ๐Ÿ‡น๐Ÿ† (LREC-COLING 2024) \n"
244
  )
245
 
246
  def setup_leaderboard(readme: str):
 
319
  - [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
320
  - [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
321
  - [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
322
+ - [Prof. Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
323
 
324
  \*Equal contribution
325
  """