Junyi42 commited on
Commit
3ec791d
1 Parent(s): b05027c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -3
README.md CHANGED
@@ -4,8 +4,41 @@ tags:
4
  - image-to-3d
5
  - model_hub_mixin
6
  - pytorch_model_hub_mixin
 
7
  ---
8
 
9
- This model has been pushed to the Hub using the [PytorchModelHubMixin](https://huggingface.co/docs/huggingface_hub/package_reference/mixins#huggingface_hub.PyTorchModelHubMixin) integration:
10
- - Library: https://github.com/junyi/monst3r
11
- - Docs: [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  - image-to-3d
5
  - model_hub_mixin
6
  - pytorch_model_hub_mixin
7
+ license: mit
8
  ---
9
 
10
+ ## MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion
11
+
12
+ <video controls>
13
+ <source src="https://monst3r-project.github.io/files/teaser_vid_v2_lowres.mp4" type="video/mp4">
14
+ Your browser does not support the video tag.
15
+ </video>
16
+
17
+ ```bibtex
18
+ @article{zhang2024monst3r,
19
+ author = {Zhang, Junyi and Herrmann, Charles and Hur, Junhwa and Jampani, Varun and Darrell, Trevor and Cole, Forrester and Sun, Deqing and Yang, Ming-Hsuan},
20
+ title = {MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion},
21
+ journal = {arXiv preprint arxiv:2410.03825},
22
+ year = {2024}
23
+ }
24
+ ```
25
+
26
+ # Model info
27
+
28
+ - GitHub page: https://github.com/junyi/monst3r
29
+ - Project page: https://monst3r-project.github.io/
30
+ - Paper: https://arxiv.org/abs/2410.03825
31
+
32
+ # How to use
33
+
34
+ First, [install monst3r](https://github.com/junyi42/monst3r).
35
+ To load the model:
36
+
37
+ ```python
38
+ from dust3r.model import AsymmetricCroCo3DStereo
39
+ import torch
40
+
41
+ model = AsymmetricCroCo3DStereo.from_pretrained("Junyi42/MonST3R_PO-TA-S-W_ViTLarge_BaseDecoder_512_dpt")
42
+
43
+ device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
44
+ model.to(device)