kevinwang676 commited on
Commit
c72b35f
1 Parent(s): dd2d92a

saving checkpoint-100

Browse files
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
4
+ instance_prompt: cndhasvb
5
+ tags:
6
+ - stable-diffusion-xl
7
+ - stable-diffusion-xl-diffusers
8
+ - text-to-image
9
+ - diffusers
10
+ - lora
11
+ inference: false
12
+ datasets:
13
+ - kevinwang676/Vincent-van-Gogh
14
+ ---
15
+
16
+ # LoRA DreamBooth - kevinwang676/van-gogh-test
17
+ ## MODEL IS CURRENTLY TRAINING ...
18
+ Last checkpoint saved: checkpoint-100
19
+ These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0 trained on @fffiloni's SD-XL trainer.
20
+ The weights were trained on the concept prompt:
21
+ ```
22
+ cndhasvb
23
+ ```
24
+ Use this keyword to trigger your custom model in your prompts.
25
+ LoRA for the text encoder was enabled: False.
26
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
27
+ ## Usage
28
+ Make sure to upgrade diffusers to >= 0.19.0:
29
+ ```
30
+ pip install diffusers --upgrade
31
+ ```
32
+ In addition make sure to install transformers, safetensors, accelerate as well as the invisible watermark:
33
+ ```
34
+ pip install invisible_watermark transformers accelerate safetensors
35
+ ```
36
+ To just use the base model, you can run:
37
+ ```python
38
+ import torch
39
+ from diffusers import DiffusionPipeline, AutoencoderKL
40
+ device = "cuda" if torch.cuda.is_available() else "cpu"
41
+ vae = AutoencoderKL.from_pretrained('madebyollin/sdxl-vae-fp16-fix', torch_dtype=torch.float16)
42
+ pipe = DiffusionPipeline.from_pretrained(
43
+ "stabilityai/stable-diffusion-xl-base-1.0",
44
+ vae=vae, torch_dtype=torch.float16, variant="fp16",
45
+ use_safetensors=True
46
+ )
47
+ pipe.to(device)
48
+ # This is where you load your trained weights
49
+ specific_safetensors = "pytorch_lora_weights.safetensors"
50
+ lora_scale = 0.9
51
+ pipe.load_lora_weights(
52
+ 'kevinwang676/van-gogh-test',
53
+ weight_name = specific_safetensors,
54
+ # use_auth_token = True
55
+ )
56
+ prompt = "A majestic cndhasvb jumping from a big stone at night"
57
+ image = pipe(
58
+ prompt=prompt,
59
+ num_inference_steps=50,
60
+ cross_attention_kwargs={"scale": lora_scale}
61
+ ).images[0]
62
+ ```
checkpoint-100/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd1c895e3bfdc446455fc49df4899aae12c5df8d8c7401d9b8061b0d66f5a281
3
+ size 14989511
checkpoint-100/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4545c67f88e40af5e6586cf3093a0be629060c5b3bea8fbf620d57172c297c0
3
+ size 23401064
checkpoint-100/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:892682995eefc9bf83162b6653db2d453055de5d2657070f378608de3c968d11
3
+ size 14599
checkpoint-100/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfa44e8523f62833816d29aa6c576eaa7783e3bbdb3e132e248b1d8aaee6132b
3
+ size 557
checkpoint-100/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:906bdd391189fd16d3160fd1e198eb53687dae580f930cf3f64365609fd5f606
3
+ size 563