Hugging Face's logo

rootonchair
/
tscd-dreamshaper-7

Text-to-Image
Diffusers
stable-diffusion
lora
template:sd-lora
Model card Files Community
tscd-dreamshaper-7
File size: 2,931 Bytes 
e233a0f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c2a15bb
e233a0f
 
52751ea
e233a0f
 
c5ba91e
 
e233a0f
 
 
 
2306f6a
9277c06
 
2e68b80
9277c06
 
 
 
 
 
 
 
 
2e68b80
9277c06
c5ba91e
e233a0f
 
2306f6a
e233a0f
2306f6a
4f9d14b
e233a0f
2306f6a
 
 
 
 
 
 
e233a0f
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
 
---
tags:
- text-to-image
- stable-diffusion
- lora
- diffusers
- template:sd-lora
base_model: Lykon/dreamshaper-7
license: mit
---
# TSCD-Dreamshaper-7

<Gallery />

## Model description 

Fine-tune a distill LoRA version of [Lykon&#x2F;dreamshaper-7](https:&#x2F;&#x2F;huggingface.co&#x2F;Lykon&#x2F;dreamshaper-7) using Trajectory Segmented Consistency Model (TSCD) introduce in [Hyper-SD: Trajectory Segmented Consistency Model for
Efficient Image Synthesis](https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2404.13686)

This LoRA is fine-tuned on [laion&#x2F;conceptual-captions-12m-webdataset](https:&#x2F;&#x2F;huggingface.co&#x2F;datasets&#x2F;laion&#x2F;conceptual-captions-12m-webdataset) for 16.000 iterations using unofficial training implementation at [https:&#x2F;&#x2F;github.com&#x2F;rootonchair&#x2F;consistency_models_distill](https://github.com/rootonchair/consistency_models_distill)

# Usage
```python

import os
import torch
from diffusers import StableDiffusionPipeline, TCDScheduler

pipeline = StableDiffusionPipeline.from_pretrained("Lykon/dreamshaper-7", torch_dtype=torch.float16, safety_checker = None).to("cuda")
pipeline.load_lora_weights("rootonchair/tscd-dreamshaper-7")
pipeline.scheduler = TCDScheduler.from_config(pipeline.scheduler.config)
test_prompts = [
  "cgmech, white mecha robot, cape, science fiction, torn clothes, glowing, standing, robot joints, mecha, armor, cowboy shot, intense sunlight, silver dragonborn, outdoors, landscape, nature, volumetrics dtx",
  "Portrait photo of muscular bearded guy in a worn mech suit, elegant, sharp focus, photo by greg rutkowski, soft lighting, vibrant colors",
  "photo of a supercar, 8k uhd, high quality, road, sunset, motion blur, depth blur, cinematic, filmic image 4k",
  "a portrait of a white cat wearing glasses, highly detailed",
  "a beautiful runrise at the beach, cinematic, masterpiece",
  "A photo of beautiful mountain with realistic sunset and blue lake, highly detailed, masterpiece",
  "Self-portrait oil painting, a beautiful cyborg with golden hair, 8k",
  "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k";
]
seed = 1234
images = pipeline(test_prompts, width=512, height=512, num_inference_steps=4, guidance_scale=0, generator=torch.Generator(device="cuda").manual_seed(seed)).images
```


## Generation Result

### 2-steps inference
![image/png](https://cdn-uploads.huggingface.co/production/uploads/655647bf2f76548766fce60f/--jOuLGoeY8JhlyrI-Byu.png)

### 4-steps inference

![image/png](https://cdn-uploads.huggingface.co/production/uploads/655647bf2f76548766fce60f/t3HQX1OR24KzPUJmP3wCM.png)

### 8-steps inference

![image/png](https://cdn-uploads.huggingface.co/production/uploads/655647bf2f76548766fce60f/MweUlsKAQ2h8Vm49f5jjk.png)


## Download model

Weights for this model are available in Safetensors format.

[Download](/rootonchair/tscd-dreamshaper-7/tree/main) them in the Files & versions tab.