carsonkatri commited on
Commit
5408802
1 Parent(s): 7ed6cd2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md CHANGED
@@ -1,3 +1,50 @@
1
  ---
2
  license: openrail++
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: openrail++
3
  ---
4
+
5
+ # Texture Diffusion
6
+ This DreamBooth model is fine-tuned for diffuse textures. It produces flat textures with very little visible lighting/shadows.
7
+
8
+ ## Samples
9
+ Here are a few example images (generated with 50 steps).
10
+
11
+ | pbr uneven stone wall | pbr dirt with weeds | pbr bright white marble |
12
+ | --- | --- | --- |
13
+ | ![](samples/pbr%20uneven%20stone%20wall.png) | ![](samples/pbr%20dirt%20with%20weeds.png) | ![](samples/pbr%20bright%20white%20marble.png) |
14
+
15
+ ## Usage
16
+ Use the token `pbr` in your prompts to invoke the style.
17
+
18
+ This model was made for use in [Dream Textures](https://github.com/carson-katri/dream-textures), a Stable Diffusion add-on for Blender.
19
+
20
+ You can also use it with [🧨 diffusers](https://github.com/huggingface/diffusers):
21
+
22
+ ```python
23
+ from diffusers import StableDiffusionPipeline
24
+ import torch
25
+
26
+ model_id = "dream-textures/texture-diffusion"
27
+
28
+ pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
29
+ pipe = pipe.to("cuda")
30
+
31
+ prompt = "pbr brick wall"
32
+ image = pipe(prompt).images[0]
33
+
34
+ image.save("bricks.png")
35
+ ```
36
+
37
+ ## Training Details
38
+
39
+ * Base Model: [stabilityai/stable-diffusion-2-base](https://huggingface.co/stabilityai/stable-diffusion-2-base)
40
+ * Resolution: `512`
41
+ * Prior Loss Weight: `1.0`
42
+ * Class Prompt: `texture`
43
+ * Batch Size: `1`
44
+ * Learning Rate: `1e-6`
45
+ * Precision: `fp16`
46
+ * Steps: `4000`
47
+ * GPU: Tesla T4
48
+
49
+ ### Dataset
50
+ This model was trained on 278 CC0 textures from [PolyHaven](https://polyhaven.com/).