bokyeong1015's picture
Update docs/description.md
ec6ef19
|
raw
history blame
2.55 kB

This demo showcases a lightweight Stable Diffusion model (SDM) for general-purpose text-to-image synthesis. Our model BK-SDM-Small achieves 36% reduced parameters and latency. This model is bulit with (i) removing several residual and attention blocks from the U-Net of SDM-v1.4 and (ii) distillation pretraining on only 0.22M LAION pairs (fewer than 0.1% of the full training set). Despite very limited training resources, our model can imitate the original SDM by benefiting from transferred knowledge.

U-Net architectures and KD-based pretraining

Notice

Acknowledgments

Demo Environment

  • Regardless of machine types, our compressed model achieves speedups while preserving visually compelling results.
  • [June/30/2023] Free CPU-basic (2 vCPU · 16 GB RAM) — 7~10 min slow inference of the original SDM.
    • Because free CPU resources are dynamically allocated with other demos, it may take much longer, depending on the server situation.
  • [May/31/2023] NVIDIA T4-small (4 vCPU · 15 GB RAM · 16GB VRAM) — 5~10 sec inference of the original SDM (for a 512×512 image with 25 denoising steps).