Amazon EC2 Inf2 Instances
- Instance Size: inf2.xlarge
- https://aws.amazon.com/ec2/instance-types/inf2/
How to use Diffusers library for inference
from optimum.neuron import NeuronStableDiffusionXLPipeline
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
stable_diffusion_xl = NeuronStableDiffusionXLPipeline.from_pretrained(
model_id="dminhk/stable-diffusion-xl-base-1.0-neuronx", device_ids=[0, 1]
)
image = stable_diffusion_xl(prompt).images[0]