Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,44 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- Oysiyl/google-android-toy
|
5 |
+
language:
|
6 |
+
- en
|
7 |
---
|
8 |
+
|
9 |
+
### Demo
|
10 |
+
You can try the demo [here](https://sdloraandroidtoy.streamlit.app/).
|
11 |
+
|
12 |
+
For hosting the [frontend](https://github.com/dmitriy-kisil/sd_lora_android_toy_frontend) part [Streamlit Community Cloud](https://streamlit.io/cloud) and [Cerebrium](https://www.cerebrium.ai/) for the [backend](https://github.com/dmitriy-kisil/sd_lora_android_toy_backend) part were used.
|
13 |
+
|
14 |
+
### Model card
|
15 |
+
|
16 |
+
Finetuned from SD 1.5 using LoRA on a custom dataset [link](https://huggingface.co/datasets/Oysiyl/google-android-toy).
|
17 |
+
|
18 |
+
W&B [run](https://wandb.ai/logart1995/text2image-fine-tune/runs/2o98mhc7?workspace=user-logart1995).
|
19 |
+
|
20 |
+
### Inference
|
21 |
+
|
22 |
+
```py
|
23 |
+
from diffusers import AutoPipelineForText2Image
|
24 |
+
import torch
|
25 |
+
|
26 |
+
pipe = AutoPipelineForText2Image.from_pretrained("runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16)
|
27 |
+
pipe.load_lora_weights("Oysiyl/sd-lora-android-google-toy", weights="pytorch_lora_weights.safetensors")
|
28 |
+
pipe = pipe.to("cuda")
|
29 |
+
|
30 |
+
g = torch.Generator(device="cuda").manual_seed(42)
|
31 |
+
|
32 |
+
image = pipe("An android toy near Eiffel tower",
|
33 |
+
num_inference_steps=50,
|
34 |
+
num_images_per_prompt=1,
|
35 |
+
guidance_scale=7.5,
|
36 |
+
temperature=1.0,
|
37 |
+
generator=g).images[0]
|
38 |
+
|
39 |
+
image.save("android_toy.png")
|
40 |
+
```
|
41 |
+
|
42 |
+
### Example
|
43 |
+
|
44 |
+
![example](./images/android_toy.png)
|