6DammK9 commited on
Commit
3e32165
1 Parent(s): e69785f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -16
README.md CHANGED
@@ -10,20 +10,39 @@ tags:
10
  - merge
11
  inference: true
12
  thumbnail: >-
13
- https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/240672-1526207600-2688-1536-3-256-20240615232306.jpg
14
  widget:
15
  - text: "1boy, astolfo"
16
  example_title: "astolfo"
17
  library_name: diffusers
18
  ---
19
 
20
- # AstolfoMix-XL (TGMD-192 / TGMD / TSD / TIES-SOUP / Extended-FP64 / Baseline) #
21
 
22
  - Unsolved merge, even with experience on [SD1](https://huggingface.co/6DammK9/AstolfoMix) and [SD2](https://huggingface.co/6DammK9/AstolfoMix-SD2).
23
  - See [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_XL.MD)
24
  - Since "Extended-FP64", dedicated merger [sd-mecha](https://github.com/ljleb/sd-mecha) is used. It is the SD version of [mergekit](https://arxiv.org/abs/2403.13257).
25
  - Preview here are powered by the top session of `README.md` and converting SDXL model from A1111 standalone file into diffuers via [convert_sdxl_to_diffusers.py](https://github.com/Linaqruf/sdxl-model-converter/blob/main/convert_sdxl_to_diffusers.py). Settings may not being optimal (no CFG / PAG / FreeU etc). I'll replace the preview diffuser as soon as I upload the main model file.
26
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  ## TGMD-192 ##
28
 
29
  - Scaled up version from TGMD (from 117 to 192)
@@ -148,21 +167,21 @@ Steps: 192, Sampler: Euler, CFG scale: 4.5, Seed: 2213673007, Size: 1344x768, Mo
148
  |04|Uniform Soup|`x63-AstolfoMix-x60te0x41te1-e2e-240407-feefbf4.safetensors`|70|52|61|42|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x63-AstolfoMix-x60te0x41te1-e2e-240407-feefbf4.mecha)|
149
  |05|TIES-SOUP|`x72a-AstolfoMix-240421-feefbf4.safetensors`|73|73|73|73|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x72a-AstolfoMix-240421-feefbf4.mecha)|
150
  |06|TIES-SOUP w/ DROP|`x101a-AstolfoMix-24050903-4edc67c.safetensors`|102|102|102|102|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x101a-AstolfoMix-24050903-4edc67c.mecha)|
151
- |07|TGMD: TIES-GeometricMedian w/ DROP|`x116a-AstolfoMix-24060702-01823a9.safetensors`|117|117|117|117|[mecha](./recipes/x116a-AstolfoMix-24060702-01823a9.mecha)|
152
- |08|TGMD-192: Scaled up from TGMD|`x191a-AstolfoMix-24083001-3360d18.safetensors`|192|192|192|192|[mecha](./recipes/x191a-AstolfoMix-24083001-3360d18.mecha)|
153
-
154
- ## TGMD in nutshell ##
155
-
156
- ![24060801.png](https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/24060801.png)
157
 
158
- ![24051202.png](https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/24051202.png)
159
 
160
- ![24061701.png](https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/24061701.png)
161
 
162
- - This algorithm should be linear a.k.a $O(N)$ in both time and space complexity, however the time required looks like it is reaching $O(NlogN)$.
163
 
164
- |Date|Model counts|Threads|RAM Usage (TB, FP64)|Time used (Hours, Xeon 8358 x2)|
165
- |---|---|---|---|---|
166
- |240607|117|16|1.214|14|
167
- |240622|133|8|0.900|12.5|
168
- |240830|192|8|1.446|41.5|
 
 
 
 
10
  - merge
11
  inference: true
12
  thumbnail: >-
13
+ https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/241135-2123095857-2688-1536-3-256-20241013140426.jpg
14
  widget:
15
  - text: "1boy, astolfo"
16
  example_title: "astolfo"
17
  library_name: diffusers
18
  ---
19
 
20
+ # AstolfoMix-XL (DGMLA-216 / TGMD-192 / TGMD / TSD / TIES-SOUP / Extended-FP64 / Baseline) #
21
 
22
  - Unsolved merge, even with experience on [SD1](https://huggingface.co/6DammK9/AstolfoMix) and [SD2](https://huggingface.co/6DammK9/AstolfoMix-SD2).
23
  - See [full article in Github](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/README_XL.MD)
24
  - Since "Extended-FP64", dedicated merger [sd-mecha](https://github.com/ljleb/sd-mecha) is used. It is the SD version of [mergekit](https://arxiv.org/abs/2403.13257).
25
  - Preview here are powered by the top session of `README.md` and converting SDXL model from A1111 standalone file into diffuers via [convert_sdxl_to_diffusers.py](https://github.com/Linaqruf/sdxl-model-converter/blob/main/convert_sdxl_to_diffusers.py). Settings may not being optimal (no CFG / PAG / FreeU etc). I'll replace the preview diffuser as soon as I upload the main model file.
26
 
27
+ ## DGMLA-216 ##
28
+
29
+ - [DGMLA Merge](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch01/della.md#spinoff-dgmla)
30
+ - [Recipe](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x215a-AstolfoMix-24101101-6e545a3.mecha), [E2E merger](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/astolfo_mix_e2e.ipynb).
31
+
32
+ - Current version: `x215a-AstolfoMix-24101101-6e545a3.safetensors`
33
+ - Recommended version: "x215a"
34
+ - Recommended CFG: 4.5 (with CHG = 1.0), 3.0 (with PAG = 1.0)
35
+ - *Prompt is minimal. Even empty.*
36
+
37
+ ![241135-2123095857-2688-1536-3-256-20241013140426.jpg](https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/241135-2123095857-2688-1536-3-256-20241013140426.jpg)
38
+
39
+ ```
40
+ parameters
41
+
42
+ [halloween], (astolfo:0.98), [[[[cemetery]]]]
43
+ Steps: 256, Sampler: Euler, Schedule type: Automatic, CFG scale: 3, Seed: 2123095857, Size: 1344x768, Model hash: bdb9f136b6, Model: x215a-AstolfoMix-24101101-6e545a3, VAE hash: 235745af8d, VAE: sdxl-vae-fp16-fix.vae.safetensors, Denoising strength: 0.7, Clip skip: 2, FreeU Stages: "[{\"backbone_factor\": 1.1, \"skip_factor\": 0.6}, {\"backbone_factor\": 1.2, \"skip_factor\": 0.4}]", FreeU Schedule: "0.0, 1.0, 0.0", FreeU Version: 2, Hires upscale: 2, Hires steps: 64, Hires upscaler: Latent, Dynamic thresholding enabled: True, Mimic scale: 1, Separate Feature Channels: False, Scaling Startpoint: MEAN, Variability Measure: AD, Interpolate Phi: 0.3, Threshold percentile: 100, PAG Active: True, PAG SANF: True, PAG Scale: 1, PAG Start Step: 0, PAG End Step: 150, Version: v1.10.1
44
+ ```
45
+
46
  ## TGMD-192 ##
47
 
48
  - Scaled up version from TGMD (from 117 to 192)
 
167
  |04|Uniform Soup|`x63-AstolfoMix-x60te0x41te1-e2e-240407-feefbf4.safetensors`|70|52|61|42|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x63-AstolfoMix-x60te0x41te1-e2e-240407-feefbf4.mecha)|
168
  |05|TIES-SOUP|`x72a-AstolfoMix-240421-feefbf4.safetensors`|73|73|73|73|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x72a-AstolfoMix-240421-feefbf4.mecha)|
169
  |06|TIES-SOUP w/ DROP|`x101a-AstolfoMix-24050903-4edc67c.safetensors`|102|102|102|102|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x101a-AstolfoMix-24050903-4edc67c.mecha)|
170
+ |07|TGMD: TIES-GeometricMedian w/ DROP|`x116a-AstolfoMix-24060702-01823a9.safetensors`|117|117|117|117|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x116a-AstolfoMix-24060702-01823a9.mecha)|
171
+ |08|TGMD-192: Scaled up from TGMD|`x191a-AstolfoMix-24083001-3360d18.safetensors`|192|192|192|192|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x191a-AstolfoMix-24083001-3360d18.mecha)|
172
+ |09|DGMLA-216: Drop w/ GeoMedian and LA|`x215a-AstolfoMix-24101101-6e545a3.safetensors`|216|216|216|216|[mecha](https://github.com/6DammK9/nai-anime-pure-negative-prompt/blob/main/ch05/recipes/x215a-AstolfoMix-24101101-6e545a3.mecha)|
 
 
 
173
 
174
+ ## DGMLA in nutshell ##
175
 
176
+ ![24101502.png](https://huggingface.co/6DammK9/AstolfoMix-XL/resolve/main/24101502.png)
177
 
178
+ - This algorithm should be linear a.k.a $O(N)$ in space, and $O(NlogN)$ in time complexity. However layerwise merging introduce some constants skewing the actual experience.
179
 
180
+ |Date|Algo|Model counts|Threads|RAM Usage (TB, FP64)|Time used (Hours, Xeon 8358 x2)|
181
+ |---|---|---|---|---|---|
182
+ |240607|TGMD|117|16|1.214|14|
183
+ |240622|TGMD|133|8|< 1.0|12.5|
184
+ |240830|TGMD|192|8|1.446|41.5|
185
+ |241002|DGMLA|192|16|1.452|39.1|
186
+ |241006|DGMLA|20|48|0.358|2.33|
187
+ |241011|DGMLA|216|48|3.500|36.2|