christian-dynamofl commited on
Commit
aa444a1
1 Parent(s): 244e12b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -38,11 +38,11 @@ In our recent evaluation, we used several multilingual benchmarks to assess our
38
  | Multilingual Benchmark | Language | Dynamo 8B | Mistral 7B | Llama2 13B | Bloom 7B | PolyLM 13B |
39
  |------------------------|----------|-----------|------------|------------|----------|------------|
40
  | PAWS | German | **0.516** | 0.363 | 0.377 | 0.502 | 0.390 |
41
- | | English | **0.497** | 0.311 | 0.336 | 0.422 | 0.413 |
42
- | | Spanish | **0.515** | 0.339 | 0.422 | 0.424 | 0.452 |
43
- | | Korean | **0.552** | 0.422 | 0.534 | **0.551** | 0.544 |
44
  | XCOPA | Italian | **0.710** | 0.63 | 0.692 | 0.516 | 0.644 |
45
- | | Turkish | **0.672** | 0.562 | 0.550 | 0.520 | 0.574 |
46
  | xstorycloze | Spanish | **0.645** | 0.632 | 0.622 | 0.639 | **0.642** |
47
 
48
 
 
38
  | Multilingual Benchmark | Language | Dynamo 8B | Mistral 7B | Llama2 13B | Bloom 7B | PolyLM 13B |
39
  |------------------------|----------|-----------|------------|------------|----------|------------|
40
  | PAWS | German | **0.516** | 0.363 | 0.377 | 0.502 | 0.390 |
41
+ | PAWS | English | **0.497** | 0.311 | 0.336 | 0.422 | 0.413 |
42
+ | PAWS | Spanish | **0.515** | 0.339 | 0.422 | 0.424 | 0.452 |
43
+ | PAWS | Korean | **0.552** | 0.422 | 0.534 | **0.551** | 0.544 |
44
  | XCOPA | Italian | **0.710** | 0.63 | 0.692 | 0.516 | 0.644 |
45
+ | XCOPA | Turkish | **0.672** | 0.562 | 0.550 | 0.520 | 0.574 |
46
  | xstorycloze | Spanish | **0.645** | 0.632 | 0.622 | 0.639 | **0.642** |
47
 
48