HuggingFaceM4
/

Idefics3-8B-Llama3

Image-Text-to-Text

Inference Endpoints

Model card Files Files and versions Community

HugoLaurencon commited on Aug 6, 2024

Commit

8ed28d9

·

verified ·

1 Parent(s): 2177c2f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -57,7 +57,7 @@ Idefics3 demonstrates a net improvement over Idefics2, especially in document un
 | Model           | MMMU <br>(val)   | MathVista <br>(test)   | MMStar <br>(val)    | DocVQA <br>(test)    | TextVQA <br>(val) |
 |:---------------:|:----------------:|:----------------------:|:-------------------:|:--------------------:|:-----------------:|
 | **Idefics2-8B** | 45.2             | 52.2                   | 49.5                | 74.0                 | 73.0              |
-| **Idefics3-8B** | 45.2             | 52.2                   | 49.5                | 74.0                 | 73.0              |
 **Idefics2 introduces several changes compared to Idefics2:**

 | Model           | MMMU <br>(val)   | MathVista <br>(test)   | MMStar <br>(val)    | DocVQA <br>(test)    | TextVQA <br>(val) |
 |:---------------:|:----------------:|:----------------------:|:-------------------:|:--------------------:|:-----------------:|
 | **Idefics2-8B** | 45.2             | 52.2                   | 49.5                | 74.0                 | 73.0              |
+| **Idefics3-8B** | 46.6             | 58.4                   | 55.9                | 87.7                 | 74.9              |
 **Idefics2 introduces several changes compared to Idefics2:**