VictorSanh commited on
Commit
9dede18
β€’
1 Parent(s): 55bae09

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -78,14 +78,14 @@ IDEFICS-2 exhibits strong performance for a model of its size (8B parameters) wh
78
  | [LLaVa-NeXT-34B](https://huggingface.co/liuhaotian/llava-v1.6-34b) | βœ… | 34B | 2880 | 51.1/44.7 | 46.5 | 69.5 | 79.3 | 83.7 | - | - |
79
  | MM1-Chat-7B | ❌ | 7B | 720 | 37.0/35.6 | 35.9 | 72.8 | 72.3 | - | - |
80
  | MM1-Chat-30B | ❌ | 30B | 720 | 44.7/40.3 | 39.4 | 73.5 | 75.1 | 83.7 | |
81
- | Gemini 1.0 Pro | ❌ | ? | ? | 47.9/- | 45.2 | 74.6 | - | 71.2 | 88.1 |
82
- | Gemini 1.5 Pro | ❌ | ? | ? | 58.5/- | 52.1 | 73.5 | - | 73.2 | 86.5 |
83
- | Claude 3 Haiku | ❌ |? | ? | 50.2/- | 46.4 | - | - | - | 88.8 |
84
  | | | | | | | |
85
- | [Idefics1 instruct](https://huggingface.co/HuggingFaceM4/idefics-80b-instruct) (32-shots) | βœ… | 80B | - | - | - | 39.3 | - | 68.8 | - |
86
  | | | | | | | |
87
- | **Idefics2** (w/o im. split) | βœ… | 8B | 64 | 43.5/37.9 | 51.6 | 70.4 | 76.8 | 80.8 | 67.3 |
88
- | **Idefics2** (w/ im. split) | βœ… | 8B | 320 | 43.0/37.7 | 51.4 | 73.0 | 76.7 | 81.2 | 74.0 |
89
 
90
  </details>
91
 
 
78
  | [LLaVa-NeXT-34B](https://huggingface.co/liuhaotian/llava-v1.6-34b) | βœ… | 34B | 2880 | 51.1/44.7 | 46.5 | 69.5 | 79.3 | 83.7 | - | - |
79
  | MM1-Chat-7B | ❌ | 7B | 720 | 37.0/35.6 | 35.9 | 72.8 | 72.3 | - | - |
80
  | MM1-Chat-30B | ❌ | 30B | 720 | 44.7/40.3 | 39.4 | 73.5 | 75.1 | 83.7 | |
81
+ | Gemini 1.0 Pro | ❌ | πŸ€·β€β™‚οΈ | πŸ€·β€β™‚οΈ | 47.9/- | 45.2 | 74.6 | - | 71.2 | 88.1 |
82
+ | Gemini 1.5 Pro | ❌ | πŸ€·β€β™‚οΈ | πŸ€·β€β™‚οΈ | 58.5/- | 52.1 | 73.5 | - | 73.2 | 86.5 |
83
+ | Claude 3 Haiku | ❌ | πŸ€·β€β™‚οΈ | πŸ€·β€β™‚οΈ | 50.2/- | 46.4 | - | - | - | 88.8 |
84
  | | | | | | | |
85
+ | [IDEFICS-1 instruct](https://huggingface.co/HuggingFaceM4/idefics-80b-instruct) (32-shots) | βœ… | 80B | - | - | - | 39.3 | - | 68.8 | - |
86
  | | | | | | | |
87
+ | **IDEFICS-2** (w/o im. split) | βœ… | 8B | 64 | 43.5/37.9 | 51.6 | 70.4 | 76.8 | 80.8 | 67.3 |
88
+ | **IDEFICS-2** (w/ im. split) | βœ… | 8B | 320 | 43.0/37.7 | 51.4 | 73.0 | 76.7 | 81.2 | 74.0 |
89
 
90
  </details>
91