File size: 1,443 Bytes
172d5f2
 
 
 
 
 
 
 
 
 
c0314c1
 
 
172d5f2
d755d29
d582a35
d755d29
172d5f2
d755d29
8799257
 
 
172d5f2
 
0323099
8799257
 
 
 
 
172d5f2
 
8799257
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
---
tags:
- text-to-image
- stable-diffusion
---

# Control-LoRA Model Card


## Model
Combining the power of ControlNet and low-rank parameter efficient fine tuning, we introduce Control-LoRAs.

By integrating the strengths of both approaches, this offers a more efficient and compact method to bring model control for a wider variety of consumer GPUs.

### MiDaS and ClipDrop Depth
![canny](samples/depth-sample.jpeg)

### Canny Edge
![canny](samples/canny-sample.jpeg)
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.

This Control-LoRA uses the edges from an image to guide the generation.

### Photograph and Sketch Colorizer
![photograph colorizer](samples/colorizer-sample.jpeg)
These two Control-LoRAs can be used to colorize images.

The first is designed to colorize black and white photographs.

The second is designed to color in sketches input as a white-on-black image (either hand-drawn, or created with a `SoftEdge_PIDI` model).

### Revision
![revision](thumbnails/stability-clora-revision-thumbnail.jpeg)
Revision is a novel approach of using images to prompt SDXL.

It uses pooled CLIP embeddings to produce images conceptually similar to the input. It can be used either in addition, or to replace text prompts.

Revision also includes a blending function for combining multiple image or text concepts, as either positive or negative prompts.