flux1-dev.safetensors file origins

#429
by yenk4 - opened

Where does "flux1-dev.safetensors" file come from? How was its state_dict saved? What is the python model, from which the weights come from? When I load the pipeline and compare pipeline.transformer 's state_dict keys with the keys from "flux1-dev.safetensors" -- they are different.
I need this to get my own file, similar to "flux1-dev.safetensors" from the pipeline, that was pretrained from this flux as a base model to further use it for training with kohya_ss.

Figured out, that those are the weights of the class Flux from here https://github.com/black-forest-labs/flux/blob/main/src/flux/model.py :)
Is there a way to transfer the weights from class FluxTransformer2DModel to the blackforest class Flux weights?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment