Spaces:

wzxii
/

Memorization-or-Generation-of-Big-Code-Models-Leaderboard

Running

App Files Files Community

wzxii commited on Aug 27

Commit

203a9ec

•

1 Parent(s): 0539e1c

Update index.html

Files changed (1) hide show

index.html +7 -14

index.html CHANGED Viewed

@@ -56,11 +56,11 @@
                 <colgroup>
                     <col style="width: 8%">
                     <col style="width: 22%">
-                    <col style="width: 22%">
-                    <col style="width: 12%">
-                    <col style="width: 12%">
-                    <col style="width: 12%">
-                    <col style="width: 12%">
                 </colgroup>
                 <thead>
@@ -68,9 +68,7 @@
                     <th rowspan="2">Model
                         <button class="button_sort" data-direction="desc" data-type="name"></button>
                     </th>
-                    <th data-direction="desc" rowspan="2" data-type="MGI">MGI,
-                        <br/>Memorization-Generalization Index
-                        <br/>(Ori: Avg. Peak)
                         <button class="button_sort" data-direction="desc" data-type="MGI"></button>
                     </th>
                     <th colspan="2">Pass@1(temp=0)</th>
@@ -103,12 +101,7 @@
             <p><strong>Notes</strong>
             <p>
             <ul>
-                <li>MGI represents Memorization-Generalization Index, originally referred to as Contamination Ratio.</li>
-                <li>The scores of instruction-tuned models might be significantly higher on humaneval-python than other
-                    languages.
-                    We use the instruction format of
-                    <a href="https://huggingface.co/datasets/openai_humaneval" target="_blank">HumanEval</a> and
-                    <a href="https://huggingface.co/datasets/dz1/CodeScore-HumanEval-ET" target="_blank">HumanEval-ET</a>.</li>
                 <li>For more details check the 📝 About section.</li>
             </ul>
         </div>

                 <colgroup>
                     <col style="width: 8%">
                     <col style="width: 22%">
+                    <col style="width: 14%">
+                    <col style="width: 14%">
+                    <col style="width: 14%">
+                    <col style="width: 14%">
+                    <col style="width: 14%">
                 </colgroup>
                 <thead>
                     <th rowspan="2">Model
                         <button class="button_sort" data-direction="desc" data-type="name"></button>
                     </th>
+                    <th data-direction="desc" rowspan="2" data-type="MGI">MGI
                         <button class="button_sort" data-direction="desc" data-type="MGI"></button>
                     </th>
                     <th colspan="2">Pass@1(temp=0)</th>
             <p><strong>Notes</strong>
             <p>
             <ul>
+                <li>MGI represents Memorization-Generalization Index, originally referred to as Avg.Peak.</li>
                 <li>For more details check the 📝 About section.</li>
             </ul>
         </div>