This repository provides a checkpoint with trained LoRA for FLUX.1-dev model by Black Forest Labs

Training details

XLabs AI team is happy to publish fune-tuning Flux scripts, including:

LoRA 🔥
ControlNet 🔥

See our github for train script and train configs.

Training Dataset

Dataset has the following format for the training process:

├── images/
│    ├── 1.png
│    ├── 1.json
│    ├── 2.png
│    ├── 2.json
│    ├── ...

A .json file contains "caption" field with a text prompt.

Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/AlexV0iceh_DreamForge for datasets for loras

Inference

furry lora

python3 main.py \
 --prompt "Female furry Pixie with text 'hello world'" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5 --guidance 4

python3 main.py \
 --prompt "Female Orc with tribal face paint in fierce warrior armor, wielding a massive battle axe, standing in the midst of a battlefield, victorious warrior scene, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

python3 main.py \
 --prompt "Male furry Lycanthrope with fur-covered body in ancient ruins, howling at the full moon, surrounded by eerie mist, werewolf transformation, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

python3 main.py \
 --prompt "Female furry Pixie with iridescent wings in whimsical fairy attire, spreading pixie dust in a moonlit forest, mischievous sprite depiction, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

lora.safetensors falls under the FLUX.1 [dev] Non-Commercial License