|
--- |
|
tags: |
|
- text-to-image |
|
- stable-diffusion |
|
- lora |
|
- diffusers |
|
widget: |
|
- text: >- |
|
a front right right view of a normal map of a high quality 3D model of a |
|
croissant, flaky, buttery, freshly baked, delicious, breakfast pastry. |
|
normal map |
|
output: |
|
url: images/00016-generated-56421668267.png |
|
- text: >- |
|
a front right view of a albedo map of a high quality 3D model of a |
|
croissant, flaky, buttery, freshly baked, delicious. VAR2, colormap, muted |
|
realistic colors |
|
output: |
|
url: images/00017-generated-56421668268.png |
|
- text: >- |
|
a front right view of a ambient occlusion map of a high quality 3D model of |
|
a croissant, flaky pastry, buttery, delicious, freshly baked, traditional |
|
french pastry. black and white, ambmap |
|
output: |
|
url: images/00018-generated-56421668269.png |
|
- text: >- |
|
a front right view of a roughness map of a high quality 3D model of a |
|
croissant, flaky, buttery, freshly baked, delicious, French pastry, |
|
breakfast food,. black and white, small roughness variations, roughmap |
|
output: |
|
url: images/00019-generated-56421668270.png |
|
base_model: stabilityai/stable-diffusion-xl-base-1.0 |
|
instance_prompt: heighmap, colormap, roughmap, normalmap, specmap, ambmap |
|
license: apache-2.0 |
|
language: |
|
- en |
|
--- |
|
# Material Synthesis With SDXL |
|
|
|
NOTE: The Inference API uses the 3D model by default, so if you want to generate 2D textures you may want to clone to a space or run the model yourself. |
|
|
|
## Model description |
|
|
|
This is a SDXL LoRA specifically designed for generating material textures, as well as images of 3D objects with the textures already applied to them. |
|
|
|
It's recommended to use controlnet for maximum consistency between images. |
|
The model is already in a standard safetensors format, and can be readily used in A1111, ComfyUI, or any other model inference API of your choosing. |
|
This model is part of the "Material synthesis with diffusion models" project by Artemiy Zhukov. |
|
|
|
## Trigger words |
|
To represent different texture types, the model uses a two-token system for the type of texture. |
|
|
|
`heighmap` - height texture |
|
|
|
`colormap` - albedo texture |
|
|
|
`roughmap` - roughness texture |
|
|
|
`normalmap` - normal texture |
|
|
|
`specmap` - specular texture |
|
|
|
`ambmap` - ambient occlusion texture |
|
|
|
`metalmap` - metallic texture |
|
|
|
Here are some examples of the 3D model in action (although you may want to use the base if you just want top-down textures) |
|
<Gallery /> |
