openvoyage/voyage-v1

Voyage: Let's explore unexplored sea of AI Art

What is Voyage?

Voyage is basically a text to image model developed by Muhammadreza Haghiri and it is based on weights from Stable Diffusion version 2.0 and Midjourney version 4. This model helps creative people turn their ideas to artwork for free (in any sense of the word free).

How to use voyage with diffusers lib

Installing needed libraries

!pip install --upgrade git+https://github.com/huggingface/diffusers.git transformers scipy ftfy accelerate

Importing required libraries, functions and classes

These following libraries, functions and classes used by me in order to test the model. Feel free to add more of your need or remove unnecessary ones!

from diffusers import StableDiffusionPipeline, EulerDiscreteScheduler, DiffusionPipeline, DPMSolverMultistepScheduler
import torch

Setting up the model and scheduler

In order to get results like what I got, you have to set euler scheduler up. This is how you can get it:

model_id = "openvoyage/voyage-v1"

scheduler = EulerDiscreteScheduler.from_pretrained(model_id, subfolder="scheduler")
pipe = StableDiffusionPipeline.from_pretrained(model_id, scheduler=scheduler, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

but if you need DPMS scheduler, you can use this line as well:

scheduler = DPMSolverMultistepScheduler.from_pretrained(model_id, subfolder="scheduler")

Inference

prompt = "ultra realistic illustration of a young beautiful woman, intricate, elegant, sharp focus, smooth edges"
negative_prompt = ""
prompt = f'<voyage> style {prompt}'
image = pipe(prompt=prompt, negative_prompt=negative_prompt, num_inference_steps=25, width=512, height=512, guidance_scale=10).images[0]

and in order to save your images, you can use image.save() method and have it in PNG format.

Colab notebook

This github repository belongs to the responsible colab notebook of the model.

Samples