chinh102 commited on
Commit
4706c28
·
verified ·
1 Parent(s): 3a7b4c8

End of training

Browse files
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ image_0.png filter=lfs diff=lfs merge=lfs -text
37
+ image_1.png filter=lfs diff=lfs merge=lfs -text
38
+ image_2.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - stable-diffusion-xl
4
+ - stable-diffusion-xl-diffusers
5
+ - diffusers-training
6
+ - text-to-image
7
+ - diffusers
8
+ - lora
9
+ - template:sd-lora
10
+ widget:
11
+
12
+ - text: 'Anime illustration of Luffy Gear 5: white cloud-like hair, open white jacket, purple shorts. Dynamic pose against night sky with full moon or clouds. Joyful expression, wide grin. Cartoonishly flexible body, stretched limbs. Glowing effects around figure. Energetic movement, mid-jump or playful stance. Contrast between illuminated character and dark background.'
13
+ output:
14
+ url:
15
+ "image_0.png"
16
+
17
+ - text: 'Anime illustration of Luffy Gear 5: white cloud-like hair, open white jacket, purple shorts. Dynamic pose against night sky with full moon or clouds. Joyful expression, wide grin. Cartoonishly flexible body, stretched limbs. Glowing effects around figure. Energetic movement, mid-jump or playful stance. Contrast between illuminated character and dark background.'
18
+ output:
19
+ url:
20
+ "image_1.png"
21
+
22
+ - text: 'Anime illustration of Luffy Gear 5: white cloud-like hair, open white jacket, purple shorts. Dynamic pose against night sky with full moon or clouds. Joyful expression, wide grin. Cartoonishly flexible body, stretched limbs. Glowing effects around figure. Energetic movement, mid-jump or playful stance. Contrast between illuminated character and dark background.'
23
+ output:
24
+ url:
25
+ "image_2.png"
26
+
27
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
28
+ instance_prompt: a photo of <s0><s1> luffy gear 5
29
+ license: openrail++
30
+ ---
31
+
32
+ # SDXL LoRA DreamBooth - chinh102/onepiece-sdxlv1
33
+
34
+ <Gallery />
35
+
36
+ ## Model description
37
+
38
+ ### These are chinh102/onepiece-sdxlv1 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
39
+
40
+ ## Download model
41
+
42
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
43
+
44
+ - **LoRA**: download **[`onepiece-sdxlv1.safetensors` here 💾](/chinh102/onepiece-sdxlv1/blob/main/onepiece-sdxlv1.safetensors)**.
45
+ - Place it on your `models/Lora` folder.
46
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:onepiece-sdxlv1:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
47
+ - *Embeddings*: download **[`onepiece-sdxlv1_emb.safetensors` here 💾](/chinh102/onepiece-sdxlv1/blob/main/onepiece-sdxlv1_emb.safetensors)**.
48
+ - Place it on it on your `embeddings` folder
49
+ - Use it by adding `onepiece-sdxlv1_emb` to your prompt. For example, `a photo of onepiece-sdxlv1_emb luffy gear 5`
50
+ (you need both the LoRA and the embeddings as they were trained together for this LoRA)
51
+
52
+
53
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
54
+
55
+ ```py
56
+ from diffusers import AutoPipelineForText2Image
57
+ import torch
58
+ from huggingface_hub import hf_hub_download
59
+ from safetensors.torch import load_file
60
+
61
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
62
+ pipeline.load_lora_weights('chinh102/onepiece-sdxlv1', weight_name='pytorch_lora_weights.safetensors')
63
+ embedding_path = hf_hub_download(repo_id='chinh102/onepiece-sdxlv1', filename='onepiece-sdxlv1_emb.safetensors', repo_type="model")
64
+ state_dict = load_file(embedding_path)
65
+ pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
66
+ pipeline.load_textual_inversion(state_dict["clip_g"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
67
+
68
+ image = pipeline('Anime illustration of Luffy Gear 5: white cloud-like hair, open white jacket, purple shorts. Dynamic pose against night sky with full moon or clouds. Joyful expression, wide grin. Cartoonishly flexible body, stretched limbs. Glowing effects around figure. Energetic movement, mid-jump or playful stance. Contrast between illuminated character and dark background.').images[0]
69
+ ```
70
+
71
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
72
+
73
+ ## Trigger words
74
+
75
+ To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
76
+
77
+ to trigger concept `TOK` → use `<s0><s1>` in your prompt
78
+
79
+
80
+
81
+ ## Details
82
+ All [Files & versions](/chinh102/onepiece-sdxlv1/tree/main).
83
+
84
+ The weights were trained using [🧨 diffusers Advanced Dreambooth Training Script](https://github.com/huggingface/diffusers/blob/main/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py).
85
+
86
+ LoRA for the text encoder was enabled. False.
87
+
88
+ Pivotal tuning was enabled: True.
89
+
90
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
91
+
92
+
image_0.png ADDED

Git LFS Details

  • SHA256: 2e1437fba8e2159b0c96d86090934930451dc92ce9b5c1a0bd94969efa223829
  • Pointer size: 132 Bytes
  • Size of remote file: 1.25 MB
image_1.png ADDED

Git LFS Details

  • SHA256: 925e53f2684e26d9d93310608e34a19a8413a6054204c42473be3bbf2c4fda66
  • Pointer size: 132 Bytes
  • Size of remote file: 1.27 MB
image_2.png ADDED

Git LFS Details

  • SHA256: 354471ad7837795fec8387b257cf76c2e3f40348da47eadc2f9173452d234331
  • Pointer size: 132 Bytes
  • Size of remote file: 1.24 MB
onepiece-sdxlv1.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7329cc7fc7432b14f02b39bdc44efdb4809aa24cfa61ebc4348c2bf91b0547ee
3
+ size 93148104
onepiece-sdxlv1_emb.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4bc6fcbe83932606b0a7e679beab1d26b454f85b06d48275d1af91fda8d52c2
3
+ size 16536
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73642732c47802cfcf5e54315118b16bb5769e2c0fd63035cba1837b62396799
3
+ size 93065304