Model Card for Model ID
Model Details
Model Description
- Developed by: Knowledge Computing Lab, University of Minnesota: Leeje Jang, Jina Kim, Zekun Li, Yijun Lin, Min Namgung, Yao-Yi Chiang
- Shared by: Machines Reading Maps
- Model type: text spotter
- Language(s): English
- License: CC-BY-NC 2.0
Model Sources [optional]
- Repository: https://github.com/knowledge-computing/mapkurator-spotter
- Paper [optional]: [More Information Needed]
- Documentation: https://knowledge-computing.github.io/mapkurator-doc/#/
Uses
Direct Use
The model detects and recognizes text on images. It was trained specifically to identify text on a wide range of historical maps with many styles printed between ca. 1500-2000 provided by the David Rumsey Map Collection. This version of the model was trained with an English language model.
Downstream Use
Using this model for new experiments will require attention to the style and language of text on images, including (possibly) the creation of new, synthetic or other training data.
Out-of-Scope Use
Bias, Risks, and Limitations
This model will struggle to return high quality results for maps with complex fonts, low contrast images, complex background colors and textures, and non-English language words.
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
How to Get Started with the Model
Please refer to the mapKurator documentation for details: https://knowledge-computing.github.io/mapkurator-doc/#/
Training Details
Training Data
Synthetic training datasets:
- SynthText: 40k text-free background images from COCO and use them to generate synthetic text images (see the left image). Code: https://github.com/ankush-me/SynthText; Dataset: TBD.
- SynMap: "patches" of synthetic maps that mimic the text (e.g., font, spacing, orientation) and background styles in the real historical maps (see the right image). Code: TBD; Dataset: TBD.
Citation [optional]
BibTeX:
[More Information Needed]
APA:
[More Information Needed]
Model Card Authors
Yijun Lin, Katherine McDonough, Valeria Vitale
Model Card Contact
Yijun Lin, lin00786 at umn.edu