Update README.md
Browse files
README.md
CHANGED
@@ -14,15 +14,13 @@ pipeline_tag: feature-extraction
|
|
14 |
|
15 |
With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages. minicpm-visual-embedding-v0 is trained with over 30k paired query - visual document pages, including textual document, visual document, arxiv figures, industry documents, textbooks, ebooks, etc. The performance of minicpm-visual-embedding-v0 is on a par with a text embedding on text-oriented documents, and an advantages on visually-intensive documents.
|
16 |
|
17 |
-
[Github Repo](https://github.com/bokesyo/minicpm-visual-embedding)
|
18 |
-
|
19 |
![Memex Archtechture](images/memex.png)
|
20 |
|
21 |
# News
|
22 |
|
23 |
- 2024-06-27: We released our first visual embedding model checkpoint minicpm-visual-embedding-v0 on [huggingface](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0).
|
24 |
|
25 |
-
- 2024-05-08: We [
|
26 |
|
27 |
# Get started
|
28 |
|
|
|
14 |
|
15 |
With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages. minicpm-visual-embedding-v0 is trained with over 30k paired query - visual document pages, including textual document, visual document, arxiv figures, industry documents, textbooks, ebooks, etc. The performance of minicpm-visual-embedding-v0 is on a par with a text embedding on text-oriented documents, and an advantages on visually-intensive documents.
|
16 |
|
|
|
|
|
17 |
![Memex Archtechture](images/memex.png)
|
18 |
|
19 |
# News
|
20 |
|
21 |
- 2024-06-27: We released our first visual embedding model checkpoint minicpm-visual-embedding-v0 on [huggingface](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0).
|
22 |
|
23 |
+
- 2024-05-08: We [open-sourced](https://github.com/bokesyo/minicpm-visual-embedding) our training code (full-parameter tuning with GradCache and DeepSpeed, supports large batch size across multiple GPUs with zero-stage1) and eval code.
|
24 |
|
25 |
# Get started
|
26 |
|