--- license: apache-2.0 language: - en base_model: - stabilityai/stable-diffusion-xl-base-1.0 pipeline_tag: text-to-image tags: - art --- # SDXL-ProteusSigma Training with ZTSNR and NovelAI V3 Improvements - [x] 10k dataset proof of concept (completed)[link](https://huggingface.co/dataautogpt3/ProteusSigma) - [x] 500k+ dataset finetune (completed) - [ ] 12M million dataset finetune (planned)
ProteusΣ
ProteusΣ
## Example Outputs # Combined Proteus and Mobius datasets with ZTSNR and NovelAI V3 Improvements ## Model Details - **Model Type:** SDXL Fine-tuned with ZTSNR and NovelAI V3 Improvements - **Base Model:** stabilityai/stable-diffusion-xl-base-1.0 - **Training Dataset:** 500,000 high-quality images - **License:** Apache 2.0 ## Key Features - Zero Terminal SNR (ZTSNR) implementation - Increased σ_max ≈ 20000.0 (NovelAI research) - High-resolution coherence enhancements ## Training Details ### Training Configuration - **Learning Rate:** 4e-7 - **Batch Size:** 8 - **Gradient Accumulation Steps:** 8 - **Epochs:** 80 - **Optimizer:** AdamW - **Precision:** bfloat16 ## Repository and Resources - **GitHub Repository:** [SDXL-Training-Improvements](https://github.com/DataCTE/SDXL-Training-Improvements) - **Training Code:** Available in the repository - **Documentation:** [Implementation Details](https://github.com/DataCTE/SDXL-Training-Improvements/blob/main/README.md) - **Issues and Support:** [GitHub Issues](https://github.com/DataCTE/SDXL-Training-Improvements/issues) ## Citation ```bibtex @article{ossa2024improvements, title={Improvements to SDXL in NovelAI Diffusion V3}, author={Ossa, Juan and Doğan, Eren and Birch, Alex and Johnson, F.}, journal={arXiv preprint arXiv:2409.15997v2}, year={2024} } ```