Spaces:
Running
on
Zero
Running
on
Zero
init
Browse filesThis view is limited to 50 files because it contains too many changes.
See raw diff
- README.md +122 -14
- app.py +397 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/3/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/1/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/1/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/2/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/2/c.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/3/bbox.npy +3 -0
- assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/3/c.npy +3 -0
README.md
CHANGED
@@ -1,14 +1,122 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# GaussianAnything: arXiv 2024
|
2 |
+
|
3 |
+
## setup the environment (the same env as LN3Diff)
|
4 |
+
|
5 |
+
```bash
|
6 |
+
conda create -n ga python=3.10
|
7 |
+
conda activate ga
|
8 |
+
pip intall -r requrements.txt # will install the surfel Gaussians environments automatically.
|
9 |
+
```
|
10 |
+
|
11 |
+
Then, install pytorch3d with
|
12 |
+
```bash
|
13 |
+
pip install git+https://github.com/facebookresearch/pytorch3d.git@stable
|
14 |
+
```
|
15 |
+
|
16 |
+
|
17 |
+
### :dromedary_camel: TODO
|
18 |
+
|
19 |
+
- [x] Release inference code and checkpoints.
|
20 |
+
- [x] Release Training code.
|
21 |
+
- [x] Release pre-extracted latent codes for 3D diffusion training.
|
22 |
+
- [ ] Release Gradio Demo.
|
23 |
+
- [ ] Release the evaluation code.
|
24 |
+
- [ ] Lint the code.
|
25 |
+
|
26 |
+
|
27 |
+
# Inference
|
28 |
+
|
29 |
+
Be aware to change the $logdir in the bash file accordingly.
|
30 |
+
|
31 |
+
To load the checkpoint automatically: please replace ```/mnt/sfs-common/yslan/open-source``` with ```yslan/GaussianAnything/ckpts/checkpoints```.
|
32 |
+
|
33 |
+
|
34 |
+
|
35 |
+
## Text-2-3D:
|
36 |
+
|
37 |
+
Please update the caption for 3D generation in ```datasets/caption-forpaper.txt```. T o change the number of samples to be generated, please change ```$num_samples``` in the bash file.
|
38 |
+
|
39 |
+
**stage-1**:
|
40 |
+
```
|
41 |
+
bash shell_scripts/release/inference/t23d/stage1-t23d.sh
|
42 |
+
```
|
43 |
+
then, set the ```$stage_1_output_dir``` to the ```$logdir``` of the above stage.
|
44 |
+
|
45 |
+
**stage-2**:
|
46 |
+
```
|
47 |
+
bash shell_scripts/release/inference/t23d/stage2-t23d.sh
|
48 |
+
```
|
49 |
+
|
50 |
+
The results will be dumped to ```./logs/t23d/stage-2```
|
51 |
+
|
52 |
+
## I23D (requires two stage generation):
|
53 |
+
|
54 |
+
set the $data_dir accordingly. For some demo image, please download from [huggingfac.co/yslan/GaussianAnything/demo-img](https://huggingface.co/yslan/GaussianAnything/tree/main/demo-img).
|
55 |
+
|
56 |
+
**stage-1**:
|
57 |
+
```
|
58 |
+
bash shell_scripts/release/inference/i23d/i23d-stage1.sh
|
59 |
+
```
|
60 |
+
|
61 |
+
then, set the $stage_1_output_dir to the $logdir of the above stage.
|
62 |
+
|
63 |
+
**stage-2**:
|
64 |
+
```
|
65 |
+
bash shell_scripts/release/inference/i23d/i23d-stage1.sh
|
66 |
+
```
|
67 |
+
|
68 |
+
## 3D VAE Reconstruction:
|
69 |
+
|
70 |
+
To encode a 3D asset into the latent point cloud, please download the pre-trained VAE checkpoint from [huggingfac.co/yslan/gaussiananything/ckpts/vae/model_rec1965000.pt](https://huggingface.co/yslan/GaussianAnything/blob/main/ckpts/vae/model_rec1965000.pt) to ```./checkpoint/model_rec1965000.pt```.
|
71 |
+
|
72 |
+
Then, run the inference script
|
73 |
+
|
74 |
+
```bash
|
75 |
+
bash shell_scripts/release/inference/vae-3d.sh
|
76 |
+
```
|
77 |
+
|
78 |
+
This will encode the mulit-view 3D renderings in ```./assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0``` into the point-cloud structured latent code, and export them (along with the 2dgs mesh) in ```./logs/latent_dir/```. The exported latent code will be used for efficient 3D diffusion training.
|
79 |
+
|
80 |
+
|
81 |
+
|
82 |
+
# Training (Flow Matching 3D Generation)
|
83 |
+
All the training is conducted on 8 A100 (80GiB) with BF16 enabled. For training on V100, please use FP32 training by setting ```--use_amp``` False in the bash file. Feel free to tune the ```$batch_size``` in the bash file accordingly to match your VRAM.
|
84 |
+
|
85 |
+
To facilitate reproducing the performance, we have uploaded the pre-extracted poind cloud-structured latent codes to the [huggingfac.co/yslan/gaussiananything/dataset/latent.tar.gz](https://huggingface.co/yslan/GaussianAnything/blob/main/dataset/latent.tar.gz) (34GiB required). Please download the pre extracted point cloud latent codes, unzip and set the ```$mv_latent_dir``` in the bash file accordingly.
|
86 |
+
|
87 |
+
|
88 |
+
## Text to 3D:
|
89 |
+
Please donwload the 3D caption from hugging face [huggingfac.co/yslan/GaussianAnything/dataset/text_captions_3dtopia.json](https://huggingface.co/yslan/GaussianAnything/blob/main/dataset/text_captions_3dtopia.json), and put it under ```dataset```.
|
90 |
+
|
91 |
+
|
92 |
+
Note that if you want to train a specific class of Objaverse, just manually change the code at ```datasets/g_buffer_objaverse.py:3043```.
|
93 |
+
|
94 |
+
**stage-1 training (point cloud generation)**:
|
95 |
+
|
96 |
+
```
|
97 |
+
bash shell_scripts/release/train/stage2-t23d/t23d-pcd-gen.sh
|
98 |
+
```
|
99 |
+
|
100 |
+
**stage-2 training (point cloud-conditioned KL feature generation)**:
|
101 |
+
|
102 |
+
```
|
103 |
+
bash shell_scripts/release/train/stage2-t23d/t23d-klfeat-gen.sh
|
104 |
+
```
|
105 |
+
|
106 |
+
## (single-view) Image to 3D
|
107 |
+
Please download g-buffer dataset first.
|
108 |
+
|
109 |
+
**stage-1 training (point cloud generation)**:
|
110 |
+
|
111 |
+
```
|
112 |
+
bash shell_scripts/release/train/stage2-i23d/i23d-pcd-gen.sh
|
113 |
+
```
|
114 |
+
|
115 |
+
**stage-2 training (point cloud-conditioned KL feature generation)**:
|
116 |
+
|
117 |
+
```
|
118 |
+
bash shell_scripts/release/train/stage2-i23d/i23d-klfeat-gen.sh
|
119 |
+
```
|
120 |
+
|
121 |
+
<!-- # Training (3D-aware VAE)
|
122 |
+
Since the -->
|
app.py
ADDED
@@ -0,0 +1,397 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
import argparse
|
2 |
+
import spaces
|
3 |
+
import json
|
4 |
+
import sys
|
5 |
+
sys.path.append('.')
|
6 |
+
import torch
|
7 |
+
import torchvision
|
8 |
+
from torchvision import transforms
|
9 |
+
import numpy as np
|
10 |
+
|
11 |
+
import os
|
12 |
+
import gc
|
13 |
+
import dnnlib
|
14 |
+
from omegaconf import OmegaConf
|
15 |
+
from PIL import Image
|
16 |
+
from dnnlib.util import EasyDict
|
17 |
+
|
18 |
+
import gradio as gr
|
19 |
+
|
20 |
+
import rembg
|
21 |
+
|
22 |
+
from huggingface_hub import hf_hub_download
|
23 |
+
|
24 |
+
|
25 |
+
"""
|
26 |
+
Generate a large batch of image samples from a model and save them as a large
|
27 |
+
numpy array. This can be used to produce samples for FID evaluation.
|
28 |
+
"""
|
29 |
+
|
30 |
+
import os
|
31 |
+
|
32 |
+
|
33 |
+
from pdb import set_trace as st
|
34 |
+
import imageio
|
35 |
+
import numpy as np
|
36 |
+
import torch as th
|
37 |
+
import torch.distributed as dist
|
38 |
+
|
39 |
+
from guided_diffusion import dist_util, logger
|
40 |
+
from guided_diffusion.script_util import (
|
41 |
+
NUM_CLASSES,
|
42 |
+
model_and_diffusion_defaults,
|
43 |
+
create_model_and_diffusion,
|
44 |
+
add_dict_to_argparser,
|
45 |
+
args_to_dict,
|
46 |
+
continuous_diffusion_defaults,
|
47 |
+
control_net_defaults,
|
48 |
+
)
|
49 |
+
|
50 |
+
th.backends.cuda.matmul.allow_tf32 = True
|
51 |
+
th.backends.cudnn.allow_tf32 = True
|
52 |
+
th.backends.cudnn.enabled = True
|
53 |
+
|
54 |
+
from pathlib import Path
|
55 |
+
|
56 |
+
from tqdm import tqdm, trange
|
57 |
+
import dnnlib
|
58 |
+
from nsr.train_util_diffusion import TrainLoop3DDiffusion as TrainLoop
|
59 |
+
from guided_diffusion.continuous_diffusion import make_diffusion as make_sde_diffusion
|
60 |
+
import nsr
|
61 |
+
import nsr.lsgm
|
62 |
+
from nsr.script_util import create_3DAE_model, encoder_and_nsr_defaults, loss_defaults, AE_with_Diffusion, rendering_options_defaults, eg3d_options_default, dataset_defaults
|
63 |
+
|
64 |
+
from datasets.shapenet import load_eval_data
|
65 |
+
from torch.utils.data import Subset
|
66 |
+
from datasets.eg3d_dataset import init_dataset_kwargs
|
67 |
+
|
68 |
+
from transport.train_utils import parse_transport_args
|
69 |
+
|
70 |
+
from utils.infer_utils import remove_background, resize_foreground
|
71 |
+
|
72 |
+
SEED = 0
|
73 |
+
|
74 |
+
def resize_to_224(img):
|
75 |
+
img = transforms.functional.resize(img, 518, # required by dino.
|
76 |
+
interpolation=transforms.InterpolationMode.LANCZOS)
|
77 |
+
return img
|
78 |
+
|
79 |
+
|
80 |
+
def set_white_background(image):
|
81 |
+
image = np.array(image).astype(np.float32) / 255.0
|
82 |
+
mask = image[:, :, 3:4]
|
83 |
+
image = image[:, :, :3] * mask + (1 - mask)
|
84 |
+
image = Image.fromarray((image * 255.0).astype(np.uint8))
|
85 |
+
return image
|
86 |
+
|
87 |
+
|
88 |
+
def check_input_image(input_image):
|
89 |
+
if input_image is None:
|
90 |
+
raise gr.Error("No image uploaded!")
|
91 |
+
|
92 |
+
|
93 |
+
|
94 |
+
def main(args_1, args_2):
|
95 |
+
|
96 |
+
os.environ['MASTER_ADDR'] = 'localhost'
|
97 |
+
os.environ['MASTER_PORT'] = '12355'
|
98 |
+
os.environ["CUDA_VISIBLE_DEVICES"] = "0"
|
99 |
+
os.environ["RANK"] = "0"
|
100 |
+
os.environ["WORLD_SIZE"] = "1"
|
101 |
+
|
102 |
+
# args.rendering_kwargs = rendering_options_defaults(args)
|
103 |
+
|
104 |
+
dist_util.setup_dist(args_1)
|
105 |
+
logger.configure(dir=args_1.logdir)
|
106 |
+
|
107 |
+
th.cuda.empty_cache()
|
108 |
+
|
109 |
+
th.cuda.manual_seed_all(SEED)
|
110 |
+
np.random.seed(SEED)
|
111 |
+
|
112 |
+
# * set denoise model args
|
113 |
+
logger.log("creating model and diffusion...")
|
114 |
+
args_1.img_size = [args_1.image_size_encoder]
|
115 |
+
args_1.image_size = args_1.image_size_encoder # 224, follow the triplane size
|
116 |
+
|
117 |
+
args_2.img_size = [args_2.image_size_encoder]
|
118 |
+
args_2.image_size = args_2.image_size_encoder # 224, follow the triplane size
|
119 |
+
|
120 |
+
denoise_model_stage1, diffusion = create_model_and_diffusion(
|
121 |
+
**args_to_dict(args_1,
|
122 |
+
model_and_diffusion_defaults().keys()))
|
123 |
+
|
124 |
+
denoise_model_stage2, diffusion = create_model_and_diffusion(
|
125 |
+
**args_to_dict(args_2,
|
126 |
+
model_and_diffusion_defaults().keys()))
|
127 |
+
|
128 |
+
opts = eg3d_options_default()
|
129 |
+
|
130 |
+
denoise_model_stage1.to(dist_util.dev())
|
131 |
+
denoise_model_stage1.eval()
|
132 |
+
denoise_model_stage2.to(dist_util.dev())
|
133 |
+
denoise_model_stage2.eval()
|
134 |
+
|
135 |
+
# * auto-encoder reconstruction model
|
136 |
+
logger.log("creating 3DAE...")
|
137 |
+
auto_encoder = create_3DAE_model(
|
138 |
+
**args_to_dict(args_1,
|
139 |
+
encoder_and_nsr_defaults().keys()))
|
140 |
+
|
141 |
+
auto_encoder.to(dist_util.dev())
|
142 |
+
auto_encoder.eval()
|
143 |
+
|
144 |
+
# faster inference
|
145 |
+
# denoise_model = denoise_model.to(th.bfloat16)
|
146 |
+
# auto_encoder = auto_encoder.to(th.bfloat16)
|
147 |
+
|
148 |
+
# TODO, how to set the scale?
|
149 |
+
logger.log("create dataset")
|
150 |
+
|
151 |
+
if args_1.objv_dataset:
|
152 |
+
from datasets.g_buffer_objaverse import load_data, load_eval_data, load_memory_data, load_wds_data
|
153 |
+
else: # shapenet
|
154 |
+
from datasets.shapenet import load_data, load_eval_data, load_memory_data
|
155 |
+
|
156 |
+
# load data if i23d
|
157 |
+
# if args.i23d:
|
158 |
+
# data = load_eval_data(
|
159 |
+
# file_path=args.eval_data_dir,
|
160 |
+
# batch_size=args.eval_batch_size,
|
161 |
+
# reso=args.image_size,
|
162 |
+
# reso_encoder=args.image_size_encoder, # 224 -> 128
|
163 |
+
# num_workers=args.num_workers,
|
164 |
+
# load_depth=True, # for evaluation
|
165 |
+
# preprocess=auto_encoder.preprocess,
|
166 |
+
# **args_to_dict(args,
|
167 |
+
# dataset_defaults().keys()))
|
168 |
+
# else:
|
169 |
+
data = None # t23d sampling, only caption required
|
170 |
+
|
171 |
+
|
172 |
+
TrainLoop = {
|
173 |
+
'flow_matching':
|
174 |
+
nsr.lsgm.flow_matching_trainer.FlowMatchingEngine,
|
175 |
+
'flow_matching_gs':
|
176 |
+
nsr.lsgm.flow_matching_trainer.FlowMatchingEngine_gs, # slightly modified sampling and rendering for gs
|
177 |
+
}[args_1.trainer_name]
|
178 |
+
|
179 |
+
# continuous
|
180 |
+
sde_diffusion = None
|
181 |
+
|
182 |
+
auto_encoder.decoder.rendering_kwargs = args_1.rendering_kwargs
|
183 |
+
# stage_1_output_dir = args_2.stage_1_output_dir
|
184 |
+
|
185 |
+
training_loop_class_stage1 = TrainLoop(rec_model=auto_encoder,
|
186 |
+
denoise_model=denoise_model_stage1,
|
187 |
+
control_model=None, # to remove
|
188 |
+
diffusion=diffusion,
|
189 |
+
sde_diffusion=sde_diffusion,
|
190 |
+
loss_class=None,
|
191 |
+
data=data,
|
192 |
+
eval_data=None,
|
193 |
+
**args_1)
|
194 |
+
|
195 |
+
training_loop_class_stage2 = TrainLoop(rec_model=auto_encoder,
|
196 |
+
denoise_model=denoise_model_stage2,
|
197 |
+
control_model=None, # to remove
|
198 |
+
diffusion=diffusion,
|
199 |
+
sde_diffusion=sde_diffusion,
|
200 |
+
loss_class=None,
|
201 |
+
data=data,
|
202 |
+
eval_data=None,
|
203 |
+
**args_2)
|
204 |
+
|
205 |
+
|
206 |
+
css = """
|
207 |
+
h1 {
|
208 |
+
text-align: center;
|
209 |
+
display:block;
|
210 |
+
}
|
211 |
+
"""
|
212 |
+
|
213 |
+
|
214 |
+
def preprocess(input_image, preprocess_background=True, foreground_ratio=0.85):
|
215 |
+
if preprocess_background:
|
216 |
+
rembg_session = rembg.new_session()
|
217 |
+
image = input_image.convert("RGB")
|
218 |
+
image = remove_background(image, rembg_session)
|
219 |
+
image = resize_foreground(image, foreground_ratio)
|
220 |
+
image = set_white_background(image)
|
221 |
+
else:
|
222 |
+
image = input_image
|
223 |
+
if image.mode == "RGBA":
|
224 |
+
image = set_white_background(image)
|
225 |
+
image = resize_to_224(image)
|
226 |
+
return image
|
227 |
+
|
228 |
+
|
229 |
+
@spaces.GPU(duration=50)
|
230 |
+
def cascaded_generation(processed_image, seed, cfg_scale):
|
231 |
+
# gc.collect()
|
232 |
+
# stage-1, generate pcd
|
233 |
+
stage_1_pcd = training_loop_class_stage1.eval_i23d_and_export_gradio(processed_image, seed, cfg_scale)
|
234 |
+
# stage-2, generate surfel Gaussians, tsdf mesh etc.
|
235 |
+
video_path, rgb_xyz_path, post_mesh_path = training_loop_class_stage2.eval_i23d_and_export_gradio(processed_image, seed, cfg_scale)
|
236 |
+
return video_path, rgb_xyz_path, post_mesh_path, stage_1_pcd
|
237 |
+
|
238 |
+
with gr.Blocks(css=css) as demo:
|
239 |
+
gr.Markdown(
|
240 |
+
"""
|
241 |
+
# GaussianAnything: Interactive Point Cloud Latent Diffusion for 3D Generation
|
242 |
+
**GaussianAnything (arXiv 2024)** [[code](https://github.com/NIRVANALAN/GaussianAnything), [project page](https://nirvanalan.github.io/projects/GA/)] is a native 3D diffusion model that supports high-quality 2D Gaussians generation.
|
243 |
+
It first trains a 3D VAE on **Objaverse**, which compress each 3D asset into a compact point cloud-structured latent.
|
244 |
+
After that, a image/text-conditioned diffusion model is trained following LDM paradigm.
|
245 |
+
The model used in the demo adopts 3D DiT architecture and flow-matching framework, and supports single-image condition.
|
246 |
+
It is trained on 8 A100 GPUs for 1M iterations with batch size 256.
|
247 |
+
Locally, on an NVIDIA A100/A10 GPU, each image-conditioned diffusion generation can be done within 20 seconds (time varies due to the adaptive-step ODE solver used in flow-mathcing.)
|
248 |
+
Upload an image of an object or click on one of the provided examples to see how the GaussianAnything works.
|
249 |
+
|
250 |
+
The 3D viewer will render a .glb point cloud exported from the centers of the surfel Gaussians, and an integrated TSDF mesh.
|
251 |
+
For best results run the demo locally and render locally - to do so, clone the [main repository](https://github.com/NIRVANALAN/GaussianAnything).
|
252 |
+
"""
|
253 |
+
)
|
254 |
+
with gr.Row(variant="panel"):
|
255 |
+
with gr.Column():
|
256 |
+
with gr.Row():
|
257 |
+
input_image = gr.Image(
|
258 |
+
label="Input Image",
|
259 |
+
image_mode="RGBA",
|
260 |
+
sources="upload",
|
261 |
+
type="pil",
|
262 |
+
elem_id="content_image",
|
263 |
+
)
|
264 |
+
processed_image = gr.Image(label="Processed Image", interactive=False)
|
265 |
+
|
266 |
+
# params
|
267 |
+
with gr.Row():
|
268 |
+
with gr.Column():
|
269 |
+
with gr.Row():
|
270 |
+
# with gr.Group():
|
271 |
+
|
272 |
+
cfg_scale = gr.Number(
|
273 |
+
label="CFG-scale", value=4.0, interactive=True,
|
274 |
+
)
|
275 |
+
seed = gr.Number(
|
276 |
+
label="Seed", value=42, interactive=True,
|
277 |
+
)
|
278 |
+
|
279 |
+
# num_steps = gr.Number(
|
280 |
+
# label="ODE Sampling Steps", value=250, interactive=True,
|
281 |
+
# )
|
282 |
+
|
283 |
+
# with gr.Column():
|
284 |
+
# with gr.Row():
|
285 |
+
# mesh_size = gr.Number(
|
286 |
+
# label="Mesh Resolution", value=192, interactive=True,
|
287 |
+
# )
|
288 |
+
|
289 |
+
# mesh_thres = gr.Number(
|
290 |
+
# label="Mesh Iso-surface", value=10, interactive=True,
|
291 |
+
# )
|
292 |
+
|
293 |
+
with gr.Row():
|
294 |
+
with gr.Group():
|
295 |
+
preprocess_background = gr.Checkbox(
|
296 |
+
label="Remove Background", value=False
|
297 |
+
)
|
298 |
+
with gr.Row():
|
299 |
+
submit = gr.Button("Generate", elem_id="generate", variant="primary")
|
300 |
+
|
301 |
+
with gr.Row(variant="panel"):
|
302 |
+
gr.Examples(
|
303 |
+
examples=[
|
304 |
+
str(path) for path in sorted(Path('./assets/demo-image-for-i23d/instantmesh').glob('**/*.png'))
|
305 |
+
] + [str(path) for path in sorted(Path('./assets/demo-image-for-i23d/gso').glob('**/*.png'))],
|
306 |
+
inputs=[input_image],
|
307 |
+
cache_examples=False,
|
308 |
+
label="Examples",
|
309 |
+
examples_per_page=20,
|
310 |
+
)
|
311 |
+
|
312 |
+
with gr.Column():
|
313 |
+
with gr.Row():
|
314 |
+
with gr.Tab("Stage-2 Output"):
|
315 |
+
with gr.Column():
|
316 |
+
output_video = gr.Video(value=None, width=512, label="Rendered Video (2 LoDs)", autoplay=True, loop=True)
|
317 |
+
# output_video = gr.Video(value=None, width=256, label="Rendered Video", autoplay=True)
|
318 |
+
output_gs = gr.Model3D(
|
319 |
+
height=256,
|
320 |
+
label="2DGS Center",
|
321 |
+
pan_speed=0.5,
|
322 |
+
clear_color=(1,1,1,1), # loading glb file only.
|
323 |
+
)
|
324 |
+
output_model = gr.Model3D(
|
325 |
+
height=256,
|
326 |
+
label="TSDF Mesh",
|
327 |
+
pan_speed=0.5,
|
328 |
+
clear_color=(1,1,1,1), # loading tsdf ply files.
|
329 |
+
)
|
330 |
+
|
331 |
+
with gr.Tab("Stage-1 Output"):
|
332 |
+
with gr.Column():
|
333 |
+
output_model_stage1 = gr.Model3D(
|
334 |
+
height=256,
|
335 |
+
label="Stage-1",
|
336 |
+
pan_speed=0.5,
|
337 |
+
clear_color=(1,1,1,1), # loading tsdf ply files.
|
338 |
+
)
|
339 |
+
|
340 |
+
|
341 |
+
|
342 |
+
gr.Markdown(
|
343 |
+
"""
|
344 |
+
## Comments:
|
345 |
+
1. The sampling time varies since ODE-based sampling method (dopri5 by default) has adaptive internal step, and reducing sampling steps may not reduce the overal sampling time. Sampling steps=250 is the emperical value that works well in most cases.
|
346 |
+
2. The 3D viewer shows a colored .glb mesh extracted from volumetric tri-plane, and may differ slightly with the volume rendering result.
|
347 |
+
3. If you find your result unsatisfying, tune the CFG scale and change the random seed. Usually slightly increase the CFG value can lead to better performance.
|
348 |
+
3. Known limitations include:
|
349 |
+
- Texture details missing: since our VAE is trained on 192x192 resolution due the the resource constraints, the texture details generated by the final 3D-LDM may be blurry. We will keep improving the performance in the future.
|
350 |
+
4. Regarding reconstruction performance, our model is slightly inferior to state-of-the-art multi-view LRM-based method (e.g. InstantMesh), but offers much better diversity, flexibility and editing potential due to the intrinsic nature of diffusion model.
|
351 |
+
|
352 |
+
## How does it work?
|
353 |
+
|
354 |
+
GaussianAnything is a native 3D Latent Diffusion Model that supports direct 3D asset generation via diffusion sampling.
|
355 |
+
Compared to SDS-based ([DreamFusion](https://dreamfusion3d.github.io/)), mulit-view generation-based ([MVDream](https://arxiv.org/abs/2308.16512), [Zero123++](https://github.com/SUDO-AI-3D/zero123plus), [Instant3D](https://instant-3d.github.io/)) and feedforward 3D reconstruction-based ([LRM](https://yiconghong.me/LRM/), [InstantMesh](https://github.com/TencentARC/InstantMesh), [LGM](https://github.com/3DTopia/LGM)),
|
356 |
+
GaussianAnything supports feedforward 3D generation with a unified framework.
|
357 |
+
Like 2D/Video AIGC pipeline, GaussianAnything first trains a 3D-VAE and then conduct LDM training (text/image conditioned) on the learned latent space. Some related methods from the industry ([Shape-E](https://github.com/openai/shap-e), [CLAY](https://github.com/CLAY-3D/OpenCLAY), [Meta 3D Gen](https://arxiv.org/abs/2303.05371)) also follow the same paradigm.
|
358 |
+
Though currently the performance of the origin 3D LDM's works are overall inferior to reconstruction-based methods, we believe the proposed method has much potential and scales better with more data and compute resources, and may yield better 3D editing performance due to its compatability with diffusion model.
|
359 |
+
For more results see the [project page](https://nirvanalan.github.io/projects/GA/).
|
360 |
+
"""
|
361 |
+
)
|
362 |
+
|
363 |
+
submit.click(fn=check_input_image, inputs=[input_image]).success(
|
364 |
+
fn=preprocess,
|
365 |
+
inputs=[input_image, preprocess_background],
|
366 |
+
outputs=[processed_image],
|
367 |
+
).success(
|
368 |
+
# fn=reconstruct_and_export,
|
369 |
+
# inputs=[processed_image],
|
370 |
+
# outputs=[output_model, output_video],
|
371 |
+
fn=cascaded_generation,
|
372 |
+
inputs=[processed_image, seed, cfg_scale],
|
373 |
+
# inputs=[processed_image, num_steps, seed, mesh_size, mesh_thres, unconditional_guidance_scale, args.stage_1_output_dir],
|
374 |
+
outputs=[output_video, output_gs, output_model, output_model_stage1],
|
375 |
+
)
|
376 |
+
|
377 |
+
demo.queue(max_size=1)
|
378 |
+
demo.launch(share=True)
|
379 |
+
|
380 |
+
if __name__ == "__main__":
|
381 |
+
|
382 |
+
os.environ[
|
383 |
+
"TORCH_DISTRIBUTED_DEBUG"] = "DETAIL" # set to DETAIL for runtime logging.
|
384 |
+
|
385 |
+
with open('configs/gradio_i23d_stage2_args.json') as f:
|
386 |
+
args_2 = json.load(f)
|
387 |
+
args_2 = EasyDict(args_2)
|
388 |
+
args_2.local_rank = 0
|
389 |
+
args_2.gpus = 1
|
390 |
+
|
391 |
+
with open('configs/gradio_i23d_stage1_args.json') as f:
|
392 |
+
args_1 = json.load(f)
|
393 |
+
args_1 = EasyDict(args_1)
|
394 |
+
args_1.local_rank = 0
|
395 |
+
args_1.gpus = 1
|
396 |
+
|
397 |
+
main(args_1, args_2)
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b80359fdef16e0762ec4ec96046d23e4db42a6d9111a901fab4d63aa6327864c
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:98b99b4d3319a30495c8726d4e9a32347938aa99e918fa86401da3eeba1c47fa
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d737f763e225f89a78191e3c629fda149b280aa4213432e06baa12433f647707
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:958056548219cde6d6dfcf0307c23a2b00e9b6dde9d2bae29081962890c849e5
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:94e5b0e456eae3296b484125aa707c4c1e5d03d2e017a710f1cb7960c1e5f8ed
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10017/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1b6285c92b810b127fa3780da3648788a9f58d2ddabd581847d802a06841c445
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4027472cdb5b3e2a4c668294960aa56861dbd886c3fe9b645e5cdf1fc3d60a89
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ede83c74f20954e83d758e15d5917dba92525bc1f6b48162510061df48c1500f
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:90b64de4f85562412008570b6210422801b05aed07f4ef9e239e6b957407cc0f
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2dbc68942442a97cf9a42723ee69c314e6970028a541b420e3a462fc0ba747f6
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:282630473f295afd5284813ee7b073d0ea3ce544445fb53d9007fbe3051689d2
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10031/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d367864f87085597f0164ad56fd83447695b4ea4245aa0d98fc67a7845839fad
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7117c23b4cc5c07630a56f65414f8b623ed67886096d96f1533ab0055a4d07b7
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a259ee690ac870ee8c9a5d528034a910d81c29bf592facde1c783fa62f5b5ac0
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9377f4782c5c8c54442ec752cb64e26b20efdc68dc532ae89fc464a98416a026
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:99e603f1f429a309d5d88ff5b98996ac59904aad7a1b17b864baef188cb7b7cd
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cd9f62a5075c9acc4bcb9ee0b1983cfece27f9ce3dbffed241cf5cf02ac8f6df
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10050/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ce7b47f5a7b3d88b1693d66af79b61aa17b424c816bb2ab1290a0ac98f59ea63
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b6bd3438f01f92caf7bb23014a5ec02b5304a3f3768ac97e408791415f222c7c
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:33030a0a3a980c9b7831e924c25b573b5d8a25961c8392971c03b06a82613c34
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f04ec25dba691e4a57fb81d4d7442b6bc729d722ee79ef51b0fe86c8566388a
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ca81a811d44f2e735a34dadb75dd261832e23f6abd79636a1fe675c1803f3d65
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e38e13c22c0cd9ffac7dc334f72c9df3dbc15948a74e73e14d807fe771018d31
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10075/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fcddb1c415599aab1e841bb4a460344427e5367490cb0d30966e96954aa0744f
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:19db7cc1d5064687a6a4144aa486a0658d94f29ed7dacae745b1d2f5e8fa47b6
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cc7da40d8b8e29ed695f04a5bd86ddefe7b700cb9e647ba56b9a2e36f1f054b6
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:42a4e4eeb24d8a262ed13521ba6e91de49474e216d61fd079ae7148ba689d172
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dc68dfa937cc6c012dfb3692f7502ba74156fa8e7a74738025e95c555726389e
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:abadb3c081d001607df41dd6572ccab30fec5a4d78e007cd27f88402cc6653d6
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10118/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6d9c402a2a9a15c935a19ee400f56ff2bbee8fc56bc628f39b6a98a162baeca0
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:44213c91567fc2754967c0b4a941499165a4f48bf781bb0bca5ee042ce0276ef
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bf128e21469f06af06597702f3816ba49caae49d60bd0cb283c9f140accc858d
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:19bdaa8de6263b6b28f45ea1078dc38684e5f299b72047af2f1253b2f89faac9
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:91ebae020c0250173070293dc8a13e0aa43c15b08caf2b65b46a9f732f897829
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d5ce368b8c1cb9b653e383e0b6bb01420e104a746e9848a855aab7d1a266ea22
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10120/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:83545b5bc970f348c3a6671f34164896a2ee1ac6b0141cb11c524ba3c98ad91f
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a3f4d41f65fbf790b9917522b4beef851a3fcd53bcc3e511c222eed13ecc2cb6
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4e03a7e43edf3103b1752d43d959393bfd2cd6d3e2afc696772ffd5fa8cc68f5
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7065dd2259f73730dc729431af3cb198afd211fbf38ac48e27b7a57f2065d5cd
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:993b9d849057f3a058449294db9cbda0f35a96e4f457d9f48b2de858e582e7db
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4605afccf0fd6fa49071150b7f9643ac79ce88c573df860b087cb8c1c1c2004f
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/10955/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:82a0e55ff4254fddcaa615b2dd12bc3d8942f76111313f588b8fc805d4698273
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/1/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:86d5b3723ac6398e61c71048af194f75406ad567aaa2a13e7e688247361a4198
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/1/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d097407848b958efa6a87f564d83965b7d3a5cca506b0abc98285ca1ce2952c2
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/2/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fb8f52f9c3eea11ead7474e50aca3b55ca26a8332c83513735cf46992968e9c2
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/2/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d89b2b9d82c1c5a06b25e4bde11aaa0e90d54a72a5e2b3e7077a0c2b8c89104d
|
3 |
+
size 1728
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/3/bbox.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3c0e86d091d7dfb76e260040b51315277b61f9ab9f52b6a81154db0c2c9ca18c
|
3 |
+
size 192
|
assets/demo-image-for-i23d/for-vae-reconstruction/Animals/0/12926/3/c.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:17430f723d12e4117b6af3e6b8bf1e68e5f0d4cfead403c1eb583f217909fc96
|
3 |
+
size 1728
|