jrrjrr commited on
Commit
6ce6b30
1 Parent(s): 9e14acb

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -0
README.md CHANGED
@@ -1,3 +1,64 @@
1
  ---
2
  license: creativeml-openrail-m
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: creativeml-openrail-m
3
+ tags:
4
+ - coreml
5
+ - stable-diffusion
6
+ - text-to-image
7
  ---
8
+ # Core ML Converted SDXL Model:
9
+
10
+ - This model was converted to [Core ML for use on Apple Silicon devices](https://github.com/apple/ml-stable-diffusion). Conversion instructions can be found [here](https://github.com/godly-devotion/MochiDiffusion/wiki/How-to-convert-ckpt-or-safetensors-files-to-Core-ML).
11
+ - Provide the model to an app such as **Mochi Diffusion** [Github](https://github.com/godly-devotion/MochiDiffusion) / [Discord](https://discord.gg/x2kartzxGv) to generate images.
12
+ - `original` version is only compatible with `CPU & GPU` option
13
+ - Resolution and bit size are as noted in the individual file names.
14
+ - This model requires macOS 14.0 or later to run properly.
15
+ - This model was converted with a `vae-encoder` for use with `image2image`.
16
+ - Descriptions are posted as-is from original model source.
17
+ - Not all features and/or results may be available in `CoreML` format.
18
+ - This model does not have the [unet split into chunks](https://github.com/apple/ml-stable-diffusion#-converting-models-to-core-ml).
19
+ - This model does not include a `safety checker` (for NSFW content).
20
+ - This model can not be used with ControlNet.
21
+
22
+ <br>
23
+
24
+ # SDXL-v10-Base+Refiner:
25
+ Source(s): [CivitAI](https://civitai.com/models/101055/sd-xl)<br>
26
+
27
+ ## SDXL v1.0 Base + Refiner
28
+
29
+ ### The official SDXL base and refiner models converted to Core ML, and packaged as a single combined model.
30
+
31
+ **The base model components will be used for the first 80% of the specified steps. Then the refiner model components will complete the remaining 20% of the steps. This is managed by Mochi Diffusion when it finds this type of combined SDXL model.**
32
+
33
+ **The individual model files in this repo have different bit depths and resolutions which are noted in the file names. The nominal model is 16 bit and 1024x1024. Other versions are reduced bits and/or lower resolution.**
34
+
35
+ ### These are large models and are zipped into smaller parts. Be sure to download all of the parts for a particular model, and combime the pieces into a single folder on your end.<br>
36
+
37
+ ## Model Description
38
+
39
+ SDXL consists of a two-step pipeline for latent diffusion: First, we use a base model to generate latents of the desired output size. In the second step, we use a specialized high-resolution model and apply a technique called SDEdit (https://arxiv.org/abs/2108.01073, also known as "img2img") to the latents generated in the first step, using the same prompt.
40
+
41
+ - Developed by: Stability AI
42
+ - Model type: Diffusion-based text-to-image generative model
43
+ - Model Description: This is a model that can be used to generate and modify images based on text prompts. It is a Latent Diffusion Model that uses two fixed, pretrained text encoders (OpenCLIP-ViT/G and CLIP-ViT/L).
44
+
45
+ **Model Sources**
46
+ - Repository: https://github.com/Stability-AI/generative-models
47
+ - Demo: https://clipdrop.co/stable-diffusion
48
+
49
+ **Uses**
50
+ - The model is intended for research purposes only. Possible research areas and tasks include
51
+ - Generation of artworks and use in design and other artistic processes.
52
+ - Applications in educational or creative tools.
53
+ - Research on generative models.
54
+ - Safe deployment of models which have the potential to generate harmful content.
55
+ - Probing and understanding the limitations and biases of generative models.<br><br>
56
+
57
+
58
+ ![image](https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9b32c2c3-88e3-464f-a63a-959877975e25/width=450/ComfyUI_00341_.jpeg)
59
+
60
+ ![image](https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6bea91aa-e28c-4df1-8391-3889e36c3bf5/width=450/ComfyUI_00325_.jpeg)
61
+
62
+ ![image](https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9ee2da9f-fd34-444f-a652-1553a1c0cabd/width=450/ComfyUI_00387_.jpeg)
63
+
64
+ ![image](https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/158ad11b-48c4-470a-aa0b-1162550ecc15/width=450/ComfyUI_00375_.jpeg)