File size: 1,450 Bytes
fbb8a30
305003b
 
 
 
 
a79c4e5
95de07f
305003b
 
 
95de07f
 
 
305003b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
95de07f
305003b
 
 
 
95de07f
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
---
tags:
- text-to-image
- creative
- control-image
- stable-diffusion
inference: true
pinned: false
datasets:
- ClaireOzzz/All_Images
- ClaireOzzz/Porcelain
license: mit
language:
- en
---

# SUTDxSUNS Spatial Project: A 2.5D Control Generator 

![image/png](https://github.com/ClaireOzzz/ImageURLhost/blob/main/Prototype%20Tests.png?raw=true)

## Status

Currently ongoing - will be completed by the 17th of December

## Demo

Try out the prototype on [COLAB](https://colab.research.google.com/drive/18FBtOWcf9jgLGV-p-ATPNtCHus2yWe-W?usp=sharing)

## Project Description

This project was for a short-term design studio that required applied deep learning and linking of existing models for spatial design. Special thanks to SUNS for providing us with data.
The controlnet training model and generation code is credited to fffiloni, while the depthmap generation to GLTF model is credited to Radamés Ajna.

[Training model](https://huggingface.co/spaces/fffiloni/train-dreambooth-lora-sdxl)
[Generation model](https://huggingface.co/spaces/fffiloni/sdxl-control-loras)
[3D Depth model](https://huggingface.co/spaces/radames/dpt-depth-estimation-3d-obj)

## Pipeline

![image/png](https://github.com/ClaireOzzz/ImageURLhost/blob/main/New%20Pipeline.png?raw=true)


### Key Features

- **User-Friendly Training Interface for non-developers**
  
- **Text-to-Image Generation with control** 

- **Specific Training Data** 

- **2.5D Visualisation** B