Spaces:
Running
on
Zero
title: Generative Data Augmentation
emoji: 🖼
colorFrom: purple
colorTo: red
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: false
Generative Data Augmentation Demo
Main GitHub Repo: Generative Data Augmentation | Image Classification Demo: Generative Augmented Classifiers.
This demo is created as part of the 'Investigating the Effectiveness of Generative Diffusion Models in Synthesizing Images for Data Augmentation in Image Classification' dissertation.
The user can augment an image by interpolating between two prompts, and specify the number of interpolation steps and the specific step to generate the image.
Demo Usage Instructions
- Upload an image.
- Enter the two prompts to interpolate between, the first prompt should contain the desired class of the augmented image, the second prompt should contain the undesired class (i.e., confusing class).
Configuration
Total Interpolation Steps: The number of steps to interpolate between the two prompts.
Interpolation Step: The specific step to generate the image.
Example for 10 steps:
Total: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10] Sampled: 4Seed: Seed value for reproducibility.
Negative Prompt: Prompt to guide the model away from generating the image.
Width, Height: The dimensions of the generated image.
Guidance Scale: The scale of the guide the model on how closely to follow the prompts.
Metadata
SSIM Score: Structural Similarity Index (SSIM) score between the original and generated image, ranges from 0 to 1. CLIP Score: CLIP similarity score between the original and generated image, ranges from 0 to 100.
Local Setup
git clone https://github.com/zhulinchng/generative-data-augmentation-demo
cd generative-data-augmentation-demo
# Setup the data directory structure as shown above
conda create --name $env_name python=3.11.* # Replace $env_name with your environment name
conda activate $env_name
# Visit PyTorch website https://pytorch.org/get-started/previous-versions/#v212 for PyTorch installation instructions.
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url # Obtain the correct URL from the PyTorch website
pip install -r requirements.txt
python app.py