p1atdev commited on
Commit
9f8613e
1 Parent(s): 7786a26

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -3
README.md CHANGED
@@ -1,3 +1,27 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: fal/AuraFlow-v0.3
4
+ base_model_relation: quantized
5
+ ---
6
+
7
+
8
+ FP8 quantized version of [AuraFlow v0.3](fal/AuraFlow-v0.3)
9
+
10
+ ## Quantization
11
+
12
+ ```py
13
+ import torch
14
+ from huggingface_hub import cached_download
15
+ from safetensors.torch import load_file, save_file
16
+
17
+ ckpt_path = cached_download(
18
+ "https://huggingface.co/fal/AuraFlow-v0.3/resolve/main/aura_flow_0.3.safetensors",
19
+ )
20
+
21
+ state_dict = load_file(ckpt_path)
22
+
23
+ for key, value in state_dict.items():
24
+ state_dict[key] = value.to(torch.float8_e4m3fn)
25
+
26
+ save_file(state_dict, "./aura_flow_0.3.float8_e4m3fn.safetensors")
27
+ ```