ClayAtlas commited on
Commit
b900e99
1 Parent(s): fb4e159

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1326 -0
README.md CHANGED
@@ -590,6 +590,1332 @@ model-index:
590
  value: 76.287
591
  - type: recall_at_5
592
  value: 81.03399999999999
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
593
  - task:
594
  type: Retrieval
595
  dataset:
 
590
  value: 76.287
591
  - type: recall_at_5
592
  value: 81.03399999999999
593
+ - task:
594
+ type: Classification
595
+ dataset:
596
+ type: mteb/amazon_massive_intent
597
+ name: MTEB MassiveIntentClassification (af)
598
+ config: af
599
+ split: test
600
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
601
+ metrics:
602
+ - type: accuracy
603
+ value: 25.79690652320108
604
+ - type: f1
605
+ value: 24.093438782440067
606
+ - task:
607
+ type: Classification
608
+ dataset:
609
+ type: mteb/amazon_massive_intent
610
+ name: MTEB MassiveIntentClassification (am)
611
+ config: am
612
+ split: test
613
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
614
+ metrics:
615
+ - type: accuracy
616
+ value: 3.338937457969066
617
+ - type: f1
618
+ value: 2.404152046553366
619
+ - task:
620
+ type: Classification
621
+ dataset:
622
+ type: mteb/amazon_massive_intent
623
+ name: MTEB MassiveIntentClassification (ar)
624
+ config: ar
625
+ split: test
626
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
627
+ metrics:
628
+ - type: accuracy
629
+ value: 6.489576328177541
630
+ - type: f1
631
+ value: 4.62270646032821
632
+ - task:
633
+ type: Classification
634
+ dataset:
635
+ type: mteb/amazon_massive_intent
636
+ name: MTEB MassiveIntentClassification (az)
637
+ config: az
638
+ split: test
639
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
640
+ metrics:
641
+ - type: accuracy
642
+ value: 24.767989240080695
643
+ - type: f1
644
+ value: 23.495689794075474
645
+ - task:
646
+ type: Classification
647
+ dataset:
648
+ type: mteb/amazon_massive_intent
649
+ name: MTEB MassiveIntentClassification (bn)
650
+ config: bn
651
+ split: test
652
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
653
+ metrics:
654
+ - type: accuracy
655
+ value: 4.29724277067922
656
+ - type: f1
657
+ value: 2.2466735164037934
658
+ - task:
659
+ type: Classification
660
+ dataset:
661
+ type: mteb/amazon_massive_intent
662
+ name: MTEB MassiveIntentClassification (cy)
663
+ config: cy
664
+ split: test
665
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
666
+ metrics:
667
+ - type: accuracy
668
+ value: 26.388702084734366
669
+ - type: f1
670
+ value: 23.86003112409349
671
+ - task:
672
+ type: Classification
673
+ dataset:
674
+ type: mteb/amazon_massive_intent
675
+ name: MTEB MassiveIntentClassification (da)
676
+ config: da
677
+ split: test
678
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
679
+ metrics:
680
+ - type: accuracy
681
+ value: 31.4694014794889
682
+ - type: f1
683
+ value: 29.017559554815392
684
+ - task:
685
+ type: Classification
686
+ dataset:
687
+ type: mteb/amazon_massive_intent
688
+ name: MTEB MassiveIntentClassification (de)
689
+ config: de
690
+ split: test
691
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
692
+ metrics:
693
+ - type: accuracy
694
+ value: 28.09011432414256
695
+ - type: f1
696
+ value: 24.796051996220104
697
+ - task:
698
+ type: Classification
699
+ dataset:
700
+ type: mteb/amazon_massive_intent
701
+ name: MTEB MassiveIntentClassification (el)
702
+ config: el
703
+ split: test
704
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
705
+ metrics:
706
+ - type: accuracy
707
+ value: 19.240080699394753
708
+ - type: f1
709
+ value: 16.13607169381968
710
+ - task:
711
+ type: Classification
712
+ dataset:
713
+ type: mteb/amazon_massive_intent
714
+ name: MTEB MassiveIntentClassification (en)
715
+ config: en
716
+ split: test
717
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
718
+ metrics:
719
+ - type: accuracy
720
+ value: 53.406186953597846
721
+ - type: f1
722
+ value: 49.55550114595557
723
+ - task:
724
+ type: Classification
725
+ dataset:
726
+ type: mteb/amazon_massive_intent
727
+ name: MTEB MassiveIntentClassification (es)
728
+ config: es
729
+ split: test
730
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
731
+ metrics:
732
+ - type: accuracy
733
+ value: 30.615332885003365
734
+ - type: f1
735
+ value: 29.13481030937436
736
+ - task:
737
+ type: Classification
738
+ dataset:
739
+ type: mteb/amazon_massive_intent
740
+ name: MTEB MassiveIntentClassification (fa)
741
+ config: fa
742
+ split: test
743
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
744
+ metrics:
745
+ - type: accuracy
746
+ value: 7.205783456624077
747
+ - type: f1
748
+ value: 4.601802513446058
749
+ - task:
750
+ type: Classification
751
+ dataset:
752
+ type: mteb/amazon_massive_intent
753
+ name: MTEB MassiveIntentClassification (fi)
754
+ config: fi
755
+ split: test
756
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
757
+ metrics:
758
+ - type: accuracy
759
+ value: 27.205783456624072
760
+ - type: f1
761
+ value: 24.177535740725418
762
+ - task:
763
+ type: Classification
764
+ dataset:
765
+ type: mteb/amazon_massive_intent
766
+ name: MTEB MassiveIntentClassification (fr)
767
+ config: fr
768
+ split: test
769
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
770
+ metrics:
771
+ - type: accuracy
772
+ value: 32.63618022864828
773
+ - type: f1
774
+ value: 31.190168140021303
775
+ - task:
776
+ type: Classification
777
+ dataset:
778
+ type: mteb/amazon_massive_intent
779
+ name: MTEB MassiveIntentClassification (he)
780
+ config: he
781
+ split: test
782
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
783
+ metrics:
784
+ - type: accuracy
785
+ value: 2.6630800268997983
786
+ - type: f1
787
+ value: 1.913464455449111
788
+ - task:
789
+ type: Classification
790
+ dataset:
791
+ type: mteb/amazon_massive_intent
792
+ name: MTEB MassiveIntentClassification (hi)
793
+ config: hi
794
+ split: test
795
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
796
+ metrics:
797
+ - type: accuracy
798
+ value: 4.593140551445864
799
+ - type: f1
800
+ value: 2.6428594688121865
801
+ - task:
802
+ type: Classification
803
+ dataset:
804
+ type: mteb/amazon_massive_intent
805
+ name: MTEB MassiveIntentClassification (hu)
806
+ config: hu
807
+ split: test
808
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
809
+ metrics:
810
+ - type: accuracy
811
+ value: 25.648957632817755
812
+ - type: f1
813
+ value: 22.88249345748577
814
+ - task:
815
+ type: Classification
816
+ dataset:
817
+ type: mteb/amazon_massive_intent
818
+ name: MTEB MassiveIntentClassification (hy)
819
+ config: hy
820
+ split: test
821
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
822
+ metrics:
823
+ - type: accuracy
824
+ value: 4.862138533960995
825
+ - type: f1
826
+ value: 2.739262235100375
827
+ - task:
828
+ type: Classification
829
+ dataset:
830
+ type: mteb/amazon_massive_intent
831
+ name: MTEB MassiveIntentClassification (id)
832
+ config: id
833
+ split: test
834
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
835
+ metrics:
836
+ - type: accuracy
837
+ value: 29.808338937457968
838
+ - type: f1
839
+ value: 29.055301842025006
840
+ - task:
841
+ type: Classification
842
+ dataset:
843
+ type: mteb/amazon_massive_intent
844
+ name: MTEB MassiveIntentClassification (is)
845
+ config: is
846
+ split: test
847
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
848
+ metrics:
849
+ - type: accuracy
850
+ value: 23.5305985205111
851
+ - type: f1
852
+ value: 21.232935753763023
853
+ - task:
854
+ type: Classification
855
+ dataset:
856
+ type: mteb/amazon_massive_intent
857
+ name: MTEB MassiveIntentClassification (it)
858
+ config: it
859
+ split: test
860
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
861
+ metrics:
862
+ - type: accuracy
863
+ value: 34.47209145931405
864
+ - type: f1
865
+ value: 32.987844813265305
866
+ - task:
867
+ type: Classification
868
+ dataset:
869
+ type: mteb/amazon_massive_intent
870
+ name: MTEB MassiveIntentClassification (ja)
871
+ config: ja
872
+ split: test
873
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
874
+ metrics:
875
+ - type: accuracy
876
+ value: 39.40147948890383
877
+ - type: f1
878
+ value: 37.59135086216479
879
+ - task:
880
+ type: Classification
881
+ dataset:
882
+ type: mteb/amazon_massive_intent
883
+ name: MTEB MassiveIntentClassification (jv)
884
+ config: jv
885
+ split: test
886
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
887
+ metrics:
888
+ - type: accuracy
889
+ value: 28.749159381304644
890
+ - type: f1
891
+ value: 26.132814845473103
892
+ - task:
893
+ type: Classification
894
+ dataset:
895
+ type: mteb/amazon_massive_intent
896
+ name: MTEB MassiveIntentClassification (ka)
897
+ config: ka
898
+ split: test
899
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
900
+ metrics:
901
+ - type: accuracy
902
+ value: 4.344317417619368
903
+ - type: f1
904
+ value: 2.9377190150068957
905
+ - task:
906
+ type: Classification
907
+ dataset:
908
+ type: mteb/amazon_massive_intent
909
+ name: MTEB MassiveIntentClassification (km)
910
+ config: km
911
+ split: test
912
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
913
+ metrics:
914
+ - type: accuracy
915
+ value: 6.102891728312036
916
+ - type: f1
917
+ value: 3.962539148306579
918
+ - task:
919
+ type: Classification
920
+ dataset:
921
+ type: mteb/amazon_massive_intent
922
+ name: MTEB MassiveIntentClassification (kn)
923
+ config: kn
924
+ split: test
925
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
926
+ metrics:
927
+ - type: accuracy
928
+ value: 4.462004034969738
929
+ - type: f1
930
+ value: 2.618811361288446
931
+ - task:
932
+ type: Classification
933
+ dataset:
934
+ type: mteb/amazon_massive_intent
935
+ name: MTEB MassiveIntentClassification (ko)
936
+ config: ko
937
+ split: test
938
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
939
+ metrics:
940
+ - type: accuracy
941
+ value: 14.156018829858777
942
+ - type: f1
943
+ value: 12.032224251194693
944
+ - task:
945
+ type: Classification
946
+ dataset:
947
+ type: mteb/amazon_massive_intent
948
+ name: MTEB MassiveIntentClassification (lv)
949
+ config: lv
950
+ split: test
951
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
952
+ metrics:
953
+ - type: accuracy
954
+ value: 29.855413584398114
955
+ - type: f1
956
+ value: 26.4935948293649
957
+ - task:
958
+ type: Classification
959
+ dataset:
960
+ type: mteb/amazon_massive_intent
961
+ name: MTEB MassiveIntentClassification (ml)
962
+ config: ml
963
+ split: test
964
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
965
+ metrics:
966
+ - type: accuracy
967
+ value: 3.6919973100201746
968
+ - type: f1
969
+ value: 1.9455177645088522
970
+ - task:
971
+ type: Classification
972
+ dataset:
973
+ type: mteb/amazon_massive_intent
974
+ name: MTEB MassiveIntentClassification (mn)
975
+ config: mn
976
+ split: test
977
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
978
+ metrics:
979
+ - type: accuracy
980
+ value: 7.864828513786145
981
+ - type: f1
982
+ value: 5.890463192551815
983
+ - task:
984
+ type: Classification
985
+ dataset:
986
+ type: mteb/amazon_massive_intent
987
+ name: MTEB MassiveIntentClassification (ms)
988
+ config: ms
989
+ split: test
990
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
991
+ metrics:
992
+ - type: accuracy
993
+ value: 28.05312710154674
994
+ - type: f1
995
+ value: 25.167919685520967
996
+ - task:
997
+ type: Classification
998
+ dataset:
999
+ type: mteb/amazon_massive_intent
1000
+ name: MTEB MassiveIntentClassification (my)
1001
+ config: my
1002
+ split: test
1003
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1004
+ metrics:
1005
+ - type: accuracy
1006
+ value: 6.9804976462676525
1007
+ - type: f1
1008
+ value: 3.5784028024922963
1009
+ - task:
1010
+ type: Classification
1011
+ dataset:
1012
+ type: mteb/amazon_massive_intent
1013
+ name: MTEB MassiveIntentClassification (nb)
1014
+ config: nb
1015
+ split: test
1016
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1017
+ metrics:
1018
+ - type: accuracy
1019
+ value: 28.648285137861468
1020
+ - type: f1
1021
+ value: 26.310748922753458
1022
+ - task:
1023
+ type: Classification
1024
+ dataset:
1025
+ type: mteb/amazon_massive_intent
1026
+ name: MTEB MassiveIntentClassification (nl)
1027
+ config: nl
1028
+ split: test
1029
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1030
+ metrics:
1031
+ - type: accuracy
1032
+ value: 32.92199058507062
1033
+ - type: f1
1034
+ value: 29.644293217296745
1035
+ - task:
1036
+ type: Classification
1037
+ dataset:
1038
+ type: mteb/amazon_massive_intent
1039
+ name: MTEB MassiveIntentClassification (pl)
1040
+ config: pl
1041
+ split: test
1042
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1043
+ metrics:
1044
+ - type: accuracy
1045
+ value: 27.622730329522525
1046
+ - type: f1
1047
+ value: 24.469668239014812
1048
+ - task:
1049
+ type: Classification
1050
+ dataset:
1051
+ type: mteb/amazon_massive_intent
1052
+ name: MTEB MassiveIntentClassification (pt)
1053
+ config: pt
1054
+ split: test
1055
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1056
+ metrics:
1057
+ - type: accuracy
1058
+ value: 33.52723604572966
1059
+ - type: f1
1060
+ value: 30.92548605264693
1061
+ - task:
1062
+ type: Classification
1063
+ dataset:
1064
+ type: mteb/amazon_massive_intent
1065
+ name: MTEB MassiveIntentClassification (ro)
1066
+ config: ro
1067
+ split: test
1068
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1069
+ metrics:
1070
+ - type: accuracy
1071
+ value: 31.32145258910558
1072
+ - type: f1
1073
+ value: 29.33012083327001
1074
+ - task:
1075
+ type: Classification
1076
+ dataset:
1077
+ type: mteb/amazon_massive_intent
1078
+ name: MTEB MassiveIntentClassification (ru)
1079
+ config: ru
1080
+ split: test
1081
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1082
+ metrics:
1083
+ - type: accuracy
1084
+ value: 11.271015467383993
1085
+ - type: f1
1086
+ value: 10.062644252034659
1087
+ - task:
1088
+ type: Classification
1089
+ dataset:
1090
+ type: mteb/amazon_massive_intent
1091
+ name: MTEB MassiveIntentClassification (sl)
1092
+ config: sl
1093
+ split: test
1094
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1095
+ metrics:
1096
+ - type: accuracy
1097
+ value: 27.942165433759254
1098
+ - type: f1
1099
+ value: 25.33080090111651
1100
+ - task:
1101
+ type: Classification
1102
+ dataset:
1103
+ type: mteb/amazon_massive_intent
1104
+ name: MTEB MassiveIntentClassification (sq)
1105
+ config: sq
1106
+ split: test
1107
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1108
+ metrics:
1109
+ - type: accuracy
1110
+ value: 32.895090786819104
1111
+ - type: f1
1112
+ value: 28.439539068323533
1113
+ - task:
1114
+ type: Classification
1115
+ dataset:
1116
+ type: mteb/amazon_massive_intent
1117
+ name: MTEB MassiveIntentClassification (sv)
1118
+ config: sv
1119
+ split: test
1120
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1121
+ metrics:
1122
+ - type: accuracy
1123
+ value: 26.852723604572965
1124
+ - type: f1
1125
+ value: 25.395656180022463
1126
+ - task:
1127
+ type: Classification
1128
+ dataset:
1129
+ type: mteb/amazon_massive_intent
1130
+ name: MTEB MassiveIntentClassification (sw)
1131
+ config: sw
1132
+ split: test
1133
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1134
+ metrics:
1135
+ - type: accuracy
1136
+ value: 29.404841963685275
1137
+ - type: f1
1138
+ value: 26.21621146728871
1139
+ - task:
1140
+ type: Classification
1141
+ dataset:
1142
+ type: mteb/amazon_massive_intent
1143
+ name: MTEB MassiveIntentClassification (ta)
1144
+ config: ta
1145
+ split: test
1146
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1147
+ metrics:
1148
+ - type: accuracy
1149
+ value: 3.3254875588433084
1150
+ - type: f1
1151
+ value: 1.603092746324846
1152
+ - task:
1153
+ type: Classification
1154
+ dataset:
1155
+ type: mteb/amazon_massive_intent
1156
+ name: MTEB MassiveIntentClassification (te)
1157
+ config: te
1158
+ split: test
1159
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1160
+ metrics:
1161
+ - type: accuracy
1162
+ value: 3.463349024882313
1163
+ - type: f1
1164
+ value: 2.0928407358339736
1165
+ - task:
1166
+ type: Classification
1167
+ dataset:
1168
+ type: mteb/amazon_massive_intent
1169
+ name: MTEB MassiveIntentClassification (th)
1170
+ config: th
1171
+ split: test
1172
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1173
+ metrics:
1174
+ - type: accuracy
1175
+ value: 12.982515131136513
1176
+ - type: f1
1177
+ value: 11.01712677163494
1178
+ - task:
1179
+ type: Classification
1180
+ dataset:
1181
+ type: mteb/amazon_massive_intent
1182
+ name: MTEB MassiveIntentClassification (tl)
1183
+ config: tl
1184
+ split: test
1185
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1186
+ metrics:
1187
+ - type: accuracy
1188
+ value: 30.729657027572294
1189
+ - type: f1
1190
+ value: 26.83317869501593
1191
+ - task:
1192
+ type: Classification
1193
+ dataset:
1194
+ type: mteb/amazon_massive_intent
1195
+ name: MTEB MassiveIntentClassification (tr)
1196
+ config: tr
1197
+ split: test
1198
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1199
+ metrics:
1200
+ - type: accuracy
1201
+ value: 23.570948217888372
1202
+ - type: f1
1203
+ value: 22.40127425434381
1204
+ - task:
1205
+ type: Classification
1206
+ dataset:
1207
+ type: mteb/amazon_massive_intent
1208
+ name: MTEB MassiveIntentClassification (ur)
1209
+ config: ur
1210
+ split: test
1211
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1212
+ metrics:
1213
+ - type: accuracy
1214
+ value: 4.983187626092804
1215
+ - type: f1
1216
+ value: 3.718347039099332
1217
+ - task:
1218
+ type: Classification
1219
+ dataset:
1220
+ type: mteb/amazon_massive_intent
1221
+ name: MTEB MassiveIntentClassification (vi)
1222
+ config: vi
1223
+ split: test
1224
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1225
+ metrics:
1226
+ - type: accuracy
1227
+ value: 21.893073301950235
1228
+ - type: f1
1229
+ value: 20.675025999929755
1230
+ - task:
1231
+ type: Classification
1232
+ dataset:
1233
+ type: mteb/amazon_massive_intent
1234
+ name: MTEB MassiveIntentClassification (zh-CN)
1235
+ config: zh-CN
1236
+ split: test
1237
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1238
+ metrics:
1239
+ - type: accuracy
1240
+ value: 70.82044384667114
1241
+ - type: f1
1242
+ value: 68.45757969594844
1243
+ - task:
1244
+ type: Classification
1245
+ dataset:
1246
+ type: mteb/amazon_massive_intent
1247
+ name: MTEB MassiveIntentClassification (zh-TW)
1248
+ config: zh-TW
1249
+ split: test
1250
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1251
+ metrics:
1252
+ - type: accuracy
1253
+ value: 65.52790854068594
1254
+ - type: f1
1255
+ value: 64.67811461805108
1256
+ - task:
1257
+ type: Classification
1258
+ dataset:
1259
+ type: mteb/amazon_massive_scenario
1260
+ name: MTEB MassiveScenarioClassification (af)
1261
+ config: af
1262
+ split: test
1263
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1264
+ metrics:
1265
+ - type: accuracy
1266
+ value: 31.55346334902488
1267
+ - type: f1
1268
+ value: 29.191252426466214
1269
+ - task:
1270
+ type: Classification
1271
+ dataset:
1272
+ type: mteb/amazon_massive_scenario
1273
+ name: MTEB MassiveScenarioClassification (am)
1274
+ config: am
1275
+ split: test
1276
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1277
+ metrics:
1278
+ - type: accuracy
1279
+ value: 7.488231338264964
1280
+ - type: f1
1281
+ value: 5.0160562127811685
1282
+ - task:
1283
+ type: Classification
1284
+ dataset:
1285
+ type: mteb/amazon_massive_scenario
1286
+ name: MTEB MassiveScenarioClassification (ar)
1287
+ config: ar
1288
+ split: test
1289
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1290
+ metrics:
1291
+ - type: accuracy
1292
+ value: 14.996637525218562
1293
+ - type: f1
1294
+ value: 11.249193510499182
1295
+ - task:
1296
+ type: Classification
1297
+ dataset:
1298
+ type: mteb/amazon_massive_scenario
1299
+ name: MTEB MassiveScenarioClassification (az)
1300
+ config: az
1301
+ split: test
1302
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1303
+ metrics:
1304
+ - type: accuracy
1305
+ value: 29.132481506388704
1306
+ - type: f1
1307
+ value: 26.38076542865094
1308
+ - task:
1309
+ type: Classification
1310
+ dataset:
1311
+ type: mteb/amazon_massive_scenario
1312
+ name: MTEB MassiveScenarioClassification (bn)
1313
+ config: bn
1314
+ split: test
1315
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1316
+ metrics:
1317
+ - type: accuracy
1318
+ value: 9.243443174176194
1319
+ - type: f1
1320
+ value: 6.038537369329211
1321
+ - task:
1322
+ type: Classification
1323
+ dataset:
1324
+ type: mteb/amazon_massive_scenario
1325
+ name: MTEB MassiveScenarioClassification (cy)
1326
+ config: cy
1327
+ split: test
1328
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1329
+ metrics:
1330
+ - type: accuracy
1331
+ value: 29.720914593140552
1332
+ - type: f1
1333
+ value: 26.928872478782672
1334
+ - task:
1335
+ type: Classification
1336
+ dataset:
1337
+ type: mteb/amazon_massive_scenario
1338
+ name: MTEB MassiveScenarioClassification (da)
1339
+ config: da
1340
+ split: test
1341
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1342
+ metrics:
1343
+ - type: accuracy
1344
+ value: 39.791526563550775
1345
+ - type: f1
1346
+ value: 35.368330225384334
1347
+ - task:
1348
+ type: Classification
1349
+ dataset:
1350
+ type: mteb/amazon_massive_scenario
1351
+ name: MTEB MassiveScenarioClassification (de)
1352
+ config: de
1353
+ split: test
1354
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1355
+ metrics:
1356
+ - type: accuracy
1357
+ value: 34.67720242098184
1358
+ - type: f1
1359
+ value: 31.39329003485599
1360
+ - task:
1361
+ type: Classification
1362
+ dataset:
1363
+ type: mteb/amazon_massive_scenario
1364
+ name: MTEB MassiveScenarioClassification (el)
1365
+ config: el
1366
+ split: test
1367
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1368
+ metrics:
1369
+ - type: accuracy
1370
+ value: 28.833221250840612
1371
+ - type: f1
1372
+ value: 25.447170771092875
1373
+ - task:
1374
+ type: Classification
1375
+ dataset:
1376
+ type: mteb/amazon_massive_scenario
1377
+ name: MTEB MassiveScenarioClassification (en)
1378
+ config: en
1379
+ split: test
1380
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1381
+ metrics:
1382
+ - type: accuracy
1383
+ value: 61.77538668459987
1384
+ - type: f1
1385
+ value: 58.638713385209904
1386
+ - task:
1387
+ type: Classification
1388
+ dataset:
1389
+ type: mteb/amazon_massive_scenario
1390
+ name: MTEB MassiveScenarioClassification (es)
1391
+ config: es
1392
+ split: test
1393
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1394
+ metrics:
1395
+ - type: accuracy
1396
+ value: 35.96839273705447
1397
+ - type: f1
1398
+ value: 32.76368046131194
1399
+ - task:
1400
+ type: Classification
1401
+ dataset:
1402
+ type: mteb/amazon_massive_scenario
1403
+ name: MTEB MassiveScenarioClassification (fa)
1404
+ config: fa
1405
+ split: test
1406
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1407
+ metrics:
1408
+ - type: accuracy
1409
+ value: 11.123066577000671
1410
+ - type: f1
1411
+ value: 7.872676893973924
1412
+ - task:
1413
+ type: Classification
1414
+ dataset:
1415
+ type: mteb/amazon_massive_scenario
1416
+ name: MTEB MassiveScenarioClassification (fi)
1417
+ config: fi
1418
+ split: test
1419
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1420
+ metrics:
1421
+ - type: accuracy
1422
+ value: 28.614660390047074
1423
+ - type: f1
1424
+ value: 25.645947438401855
1425
+ - task:
1426
+ type: Classification
1427
+ dataset:
1428
+ type: mteb/amazon_massive_scenario
1429
+ name: MTEB MassiveScenarioClassification (fr)
1430
+ config: fr
1431
+ split: test
1432
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1433
+ metrics:
1434
+ - type: accuracy
1435
+ value: 40.65568258238063
1436
+ - type: f1
1437
+ value: 37.66349602390266
1438
+ - task:
1439
+ type: Classification
1440
+ dataset:
1441
+ type: mteb/amazon_massive_scenario
1442
+ name: MTEB MassiveScenarioClassification (he)
1443
+ config: he
1444
+ split: test
1445
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1446
+ metrics:
1447
+ - type: accuracy
1448
+ value: 9.008069939475453
1449
+ - type: f1
1450
+ value: 5.1554089293899965
1451
+ - task:
1452
+ type: Classification
1453
+ dataset:
1454
+ type: mteb/amazon_massive_scenario
1455
+ name: MTEB MassiveScenarioClassification (hi)
1456
+ config: hi
1457
+ split: test
1458
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1459
+ metrics:
1460
+ - type: accuracy
1461
+ value: 9.915938130464022
1462
+ - type: f1
1463
+ value: 6.413016136448915
1464
+ - task:
1465
+ type: Classification
1466
+ dataset:
1467
+ type: mteb/amazon_massive_scenario
1468
+ name: MTEB MassiveScenarioClassification (hu)
1469
+ config: hu
1470
+ split: test
1471
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1472
+ metrics:
1473
+ - type: accuracy
1474
+ value: 32.07464694014795
1475
+ - type: f1
1476
+ value: 29.435621484770174
1477
+ - task:
1478
+ type: Classification
1479
+ dataset:
1480
+ type: mteb/amazon_massive_scenario
1481
+ name: MTEB MassiveScenarioClassification (hy)
1482
+ config: hy
1483
+ split: test
1484
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1485
+ metrics:
1486
+ - type: accuracy
1487
+ value: 8.43981170141224
1488
+ - type: f1
1489
+ value: 6.157676936089851
1490
+ - task:
1491
+ type: Classification
1492
+ dataset:
1493
+ type: mteb/amazon_massive_scenario
1494
+ name: MTEB MassiveScenarioClassification (id)
1495
+ config: id
1496
+ split: test
1497
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1498
+ metrics:
1499
+ - type: accuracy
1500
+ value: 34.89912575655683
1501
+ - type: f1
1502
+ value: 31.614865711813938
1503
+ - task:
1504
+ type: Classification
1505
+ dataset:
1506
+ type: mteb/amazon_massive_scenario
1507
+ name: MTEB MassiveScenarioClassification (is)
1508
+ config: is
1509
+ split: test
1510
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1511
+ metrics:
1512
+ - type: accuracy
1513
+ value: 30.954942837928712
1514
+ - type: f1
1515
+ value: 26.844232924337497
1516
+ - task:
1517
+ type: Classification
1518
+ dataset:
1519
+ type: mteb/amazon_massive_scenario
1520
+ name: MTEB MassiveScenarioClassification (it)
1521
+ config: it
1522
+ split: test
1523
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1524
+ metrics:
1525
+ - type: accuracy
1526
+ value: 41.059179556153325
1527
+ - type: f1
1528
+ value: 36.92471115077745
1529
+ - task:
1530
+ type: Classification
1531
+ dataset:
1532
+ type: mteb/amazon_massive_scenario
1533
+ name: MTEB MassiveScenarioClassification (ja)
1534
+ config: ja
1535
+ split: test
1536
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1537
+ metrics:
1538
+ - type: accuracy
1539
+ value: 48.73234700739745
1540
+ - type: f1
1541
+ value: 46.89395011365762
1542
+ - task:
1543
+ type: Classification
1544
+ dataset:
1545
+ type: mteb/amazon_massive_scenario
1546
+ name: MTEB MassiveScenarioClassification (jv)
1547
+ config: jv
1548
+ split: test
1549
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1550
+ metrics:
1551
+ - type: accuracy
1552
+ value: 35.08742434431742
1553
+ - type: f1
1554
+ value: 32.314520222383585
1555
+ - task:
1556
+ type: Classification
1557
+ dataset:
1558
+ type: mteb/amazon_massive_scenario
1559
+ name: MTEB MassiveScenarioClassification (ka)
1560
+ config: ka
1561
+ split: test
1562
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1563
+ metrics:
1564
+ - type: accuracy
1565
+ value: 9.287155346334904
1566
+ - type: f1
1567
+ value: 7.13459214077311
1568
+ - task:
1569
+ type: Classification
1570
+ dataset:
1571
+ type: mteb/amazon_massive_scenario
1572
+ name: MTEB MassiveScenarioClassification (km)
1573
+ config: km
1574
+ split: test
1575
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1576
+ metrics:
1577
+ - type: accuracy
1578
+ value: 11.193678547410894
1579
+ - type: f1
1580
+ value: 7.329043540295746
1581
+ - task:
1582
+ type: Classification
1583
+ dataset:
1584
+ type: mteb/amazon_massive_scenario
1585
+ name: MTEB MassiveScenarioClassification (kn)
1586
+ config: kn
1587
+ split: test
1588
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1589
+ metrics:
1590
+ - type: accuracy
1591
+ value: 10.097511768661734
1592
+ - type: f1
1593
+ value: 7.212356186519867
1594
+ - task:
1595
+ type: Classification
1596
+ dataset:
1597
+ type: mteb/amazon_massive_scenario
1598
+ name: MTEB MassiveScenarioClassification (ko)
1599
+ config: ko
1600
+ split: test
1601
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1602
+ metrics:
1603
+ - type: accuracy
1604
+ value: 19.196368527236046
1605
+ - type: f1
1606
+ value: 16.798046606500282
1607
+ - task:
1608
+ type: Classification
1609
+ dataset:
1610
+ type: mteb/amazon_massive_scenario
1611
+ name: MTEB MassiveScenarioClassification (lv)
1612
+ config: lv
1613
+ split: test
1614
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1615
+ metrics:
1616
+ - type: accuracy
1617
+ value: 32.49495628782785
1618
+ - type: f1
1619
+ value: 28.359188240241444
1620
+ - task:
1621
+ type: Classification
1622
+ dataset:
1623
+ type: mteb/amazon_massive_scenario
1624
+ name: MTEB MassiveScenarioClassification (ml)
1625
+ config: ml
1626
+ split: test
1627
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1628
+ metrics:
1629
+ - type: accuracy
1630
+ value: 6.36516476126429
1631
+ - type: f1
1632
+ value: 3.7192665599079913
1633
+ - task:
1634
+ type: Classification
1635
+ dataset:
1636
+ type: mteb/amazon_massive_scenario
1637
+ name: MTEB MassiveScenarioClassification (mn)
1638
+ config: mn
1639
+ split: test
1640
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1641
+ metrics:
1642
+ - type: accuracy
1643
+ value: 13.076664425016812
1644
+ - type: f1
1645
+ value: 9.572770203976713
1646
+ - task:
1647
+ type: Classification
1648
+ dataset:
1649
+ type: mteb/amazon_massive_scenario
1650
+ name: MTEB MassiveScenarioClassification (ms)
1651
+ config: ms
1652
+ split: test
1653
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1654
+ metrics:
1655
+ - type: accuracy
1656
+ value: 39.17955615332885
1657
+ - type: f1
1658
+ value: 33.8253960820197
1659
+ - task:
1660
+ type: Classification
1661
+ dataset:
1662
+ type: mteb/amazon_massive_scenario
1663
+ name: MTEB MassiveScenarioClassification (my)
1664
+ config: my
1665
+ split: test
1666
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1667
+ metrics:
1668
+ - type: accuracy
1669
+ value: 12.252858103564224
1670
+ - type: f1
1671
+ value: 9.096519579346872
1672
+ - task:
1673
+ type: Classification
1674
+ dataset:
1675
+ type: mteb/amazon_massive_scenario
1676
+ name: MTEB MassiveScenarioClassification (nb)
1677
+ config: nb
1678
+ split: test
1679
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1680
+ metrics:
1681
+ - type: accuracy
1682
+ value: 35.24209818426362
1683
+ - type: f1
1684
+ value: 32.24756964062884
1685
+ - task:
1686
+ type: Classification
1687
+ dataset:
1688
+ type: mteb/amazon_massive_scenario
1689
+ name: MTEB MassiveScenarioClassification (nl)
1690
+ config: nl
1691
+ split: test
1692
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1693
+ metrics:
1694
+ - type: accuracy
1695
+ value: 38.17081371889711
1696
+ - type: f1
1697
+ value: 34.8539465599922
1698
+ - task:
1699
+ type: Classification
1700
+ dataset:
1701
+ type: mteb/amazon_massive_scenario
1702
+ name: MTEB MassiveScenarioClassification (pl)
1703
+ config: pl
1704
+ split: test
1705
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1706
+ metrics:
1707
+ - type: accuracy
1708
+ value: 31.60390047074647
1709
+ - type: f1
1710
+ value: 28.24199310436465
1711
+ - task:
1712
+ type: Classification
1713
+ dataset:
1714
+ type: mteb/amazon_massive_scenario
1715
+ name: MTEB MassiveScenarioClassification (pt)
1716
+ config: pt
1717
+ split: test
1718
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1719
+ metrics:
1720
+ - type: accuracy
1721
+ value: 40.01008742434432
1722
+ - type: f1
1723
+ value: 37.21826826542489
1724
+ - task:
1725
+ type: Classification
1726
+ dataset:
1727
+ type: mteb/amazon_massive_scenario
1728
+ name: MTEB MassiveScenarioClassification (ro)
1729
+ config: ro
1730
+ split: test
1731
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1732
+ metrics:
1733
+ - type: accuracy
1734
+ value: 39.25353059852051
1735
+ - type: f1
1736
+ value: 35.457426597271784
1737
+ - task:
1738
+ type: Classification
1739
+ dataset:
1740
+ type: mteb/amazon_massive_scenario
1741
+ name: MTEB MassiveScenarioClassification (ru)
1742
+ config: ru
1743
+ split: test
1744
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1745
+ metrics:
1746
+ - type: accuracy
1747
+ value: 16.70813718897108
1748
+ - type: f1
1749
+ value: 14.338767956114001
1750
+ - task:
1751
+ type: Classification
1752
+ dataset:
1753
+ type: mteb/amazon_massive_scenario
1754
+ name: MTEB MassiveScenarioClassification (sl)
1755
+ config: sl
1756
+ split: test
1757
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1758
+ metrics:
1759
+ - type: accuracy
1760
+ value: 33.94418291862811
1761
+ - type: f1
1762
+ value: 30.577444242695694
1763
+ - task:
1764
+ type: Classification
1765
+ dataset:
1766
+ type: mteb/amazon_massive_scenario
1767
+ name: MTEB MassiveScenarioClassification (sq)
1768
+ config: sq
1769
+ split: test
1770
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1771
+ metrics:
1772
+ - type: accuracy
1773
+ value: 40.396772024209824
1774
+ - type: f1
1775
+ value: 36.028103018769436
1776
+ - task:
1777
+ type: Classification
1778
+ dataset:
1779
+ type: mteb/amazon_massive_scenario
1780
+ name: MTEB MassiveScenarioClassification (sv)
1781
+ config: sv
1782
+ split: test
1783
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1784
+ metrics:
1785
+ - type: accuracy
1786
+ value: 30.722932078009418
1787
+ - type: f1
1788
+ value: 28.49491987141746
1789
+ - task:
1790
+ type: Classification
1791
+ dataset:
1792
+ type: mteb/amazon_massive_scenario
1793
+ name: MTEB MassiveScenarioClassification (sw)
1794
+ config: sw
1795
+ split: test
1796
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1797
+ metrics:
1798
+ - type: accuracy
1799
+ value: 37.14189643577674
1800
+ - type: f1
1801
+ value: 32.52116385408168
1802
+ - task:
1803
+ type: Classification
1804
+ dataset:
1805
+ type: mteb/amazon_massive_scenario
1806
+ name: MTEB MassiveScenarioClassification (ta)
1807
+ config: ta
1808
+ split: test
1809
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1810
+ metrics:
1811
+ - type: accuracy
1812
+ value: 8.214525891055818
1813
+ - type: f1
1814
+ value: 4.448399109965533
1815
+ - task:
1816
+ type: Classification
1817
+ dataset:
1818
+ type: mteb/amazon_massive_scenario
1819
+ name: MTEB MassiveScenarioClassification (te)
1820
+ config: te
1821
+ split: test
1822
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1823
+ metrics:
1824
+ - type: accuracy
1825
+ value: 7.96570275722932
1826
+ - type: f1
1827
+ value: 5.128691464756114
1828
+ - task:
1829
+ type: Classification
1830
+ dataset:
1831
+ type: mteb/amazon_massive_scenario
1832
+ name: MTEB MassiveScenarioClassification (th)
1833
+ config: th
1834
+ split: test
1835
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1836
+ metrics:
1837
+ - type: accuracy
1838
+ value: 21.55682582380632
1839
+ - type: f1
1840
+ value: 17.110218757379613
1841
+ - task:
1842
+ type: Classification
1843
+ dataset:
1844
+ type: mteb/amazon_massive_scenario
1845
+ name: MTEB MassiveScenarioClassification (tl)
1846
+ config: tl
1847
+ split: test
1848
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1849
+ metrics:
1850
+ - type: accuracy
1851
+ value: 36.70141223940821
1852
+ - type: f1
1853
+ value: 32.96113533567822
1854
+ - task:
1855
+ type: Classification
1856
+ dataset:
1857
+ type: mteb/amazon_massive_scenario
1858
+ name: MTEB MassiveScenarioClassification (tr)
1859
+ config: tr
1860
+ split: test
1861
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1862
+ metrics:
1863
+ - type: accuracy
1864
+ value: 28.80295897780767
1865
+ - type: f1
1866
+ value: 27.77008973951413
1867
+ - task:
1868
+ type: Classification
1869
+ dataset:
1870
+ type: mteb/amazon_massive_scenario
1871
+ name: MTEB MassiveScenarioClassification (ur)
1872
+ config: ur
1873
+ split: test
1874
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1875
+ metrics:
1876
+ - type: accuracy
1877
+ value: 10.460659045057163
1878
+ - type: f1
1879
+ value: 7.90075042321315
1880
+ - task:
1881
+ type: Classification
1882
+ dataset:
1883
+ type: mteb/amazon_massive_scenario
1884
+ name: MTEB MassiveScenarioClassification (vi)
1885
+ config: vi
1886
+ split: test
1887
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1888
+ metrics:
1889
+ - type: accuracy
1890
+ value: 27.720242098184265
1891
+ - type: f1
1892
+ value: 26.76341970948208
1893
+ - task:
1894
+ type: Classification
1895
+ dataset:
1896
+ type: mteb/amazon_massive_scenario
1897
+ name: MTEB MassiveScenarioClassification (zh-CN)
1898
+ config: zh-CN
1899
+ split: test
1900
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1901
+ metrics:
1902
+ - type: accuracy
1903
+ value: 75.21183591123066
1904
+ - type: f1
1905
+ value: 74.55953469104787
1906
+ - task:
1907
+ type: Classification
1908
+ dataset:
1909
+ type: mteb/amazon_massive_scenario
1910
+ name: MTEB MassiveScenarioClassification (zh-TW)
1911
+ config: zh-TW
1912
+ split: test
1913
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1914
+ metrics:
1915
+ - type: accuracy
1916
+ value: 71.52320107599192
1917
+ - type: f1
1918
+ value: 71.16094498697193
1919
  - task:
1920
  type: Retrieval
1921
  dataset: