Update README.md

README.md

@@ -21,7 +21,7 @@ SmolVLM is a compact open multimodal model that accepts arbitrary sequences of i
 - **Model type:** Multi-modal model (image+text)
 - **Language(s) (NLP):** English
 - **License:** Apache 2.0
-- **Architecture:** Based on [Idefics3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3) (see more details below)
+- **Architecture:** Based on [Idefics3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3) (see technical summary)
 
 ## Resources
 
@@ -160,15 +160,19 @@ We release the SmolVLM checkpoints under the Apache 2.0 license.
 
 ### Training Data
 
-![Data mixture](mixture_the_cauldron.png)
+The training data comes from [The Cauldron](https://huggingface.co/datasets/HuggingFaceM4/the_cauldron) and [Docmatix](https://huggingface.co/datasets/HuggingFaceM4/Docmatix) datasets, with emphasis on document understanding (25%) and image captioning (18%), while maintaining balanced coverage across other crucial capabilities like visual reasoning, chart comprehension, and general instruction following.<img src="https://huggingface.co/HuggingFaceTB/SmolVLM-Instruct/resolve/main/mixture_the_cauldron.png" alt="Example Image" style="width:70%;" />
 
-The training data is: ![Training data](smolvlm-data.pdf)
 
 
-#### Speeds, Sizes, Times [optional]
-
-TODO
 
 ## Evaluation
 
-TODO
+| Model             | MMMU (val) | MathVista (testmini) | MMStar (val) | DocVQA (test) | TextVQA (val) | Min GPU RAM required (GB) |
+|-------------------|------------|----------------------|--------------|---------------|---------------|---------------------------|
+| SmolVLM           | 38.8       | 44.6                | 42.1         | 81.6          | 72.7          | 5.02                      |
+| Qwen-VL 2B        | 41.1       | 47.8                | 47.5         | 90.1          | 79.7          | 13.70                     |
+| InternVL2 2B      | 34.3       | 46.3                | 49.8         | 86.9          | 73.4          | 10.52                     |
+| PaliGemma 3B 448px| 34.9       | 28.7                | 48.3         | 32.2          | 56.0          | 6.72                      |
+| moondream2        | 32.4       | 24.3                | 40.3         | 70.5          | 65.2          | 3.87                      |
+| MiniCPM-V-2       | 38.2       | 39.8                | 39.1         | 71.9          | 74.1          | 7.88                      |
+| MM1.5 1B          | 35.8       | 37.2                | 0.0          | 81.0          | 72.5          | NaN                       |