|
--- |
|
language: |
|
- en |
|
license: creativeml-openrail-m |
|
thumbnail: "https://huggingface.co/Guizmus/SDArt_UnmythicalCreatures768/resolve/main/showcase.jpg" |
|
tags: |
|
- stable-diffusion |
|
- text-to-image |
|
- image-to-image |
|
--- |
|
# SDArt : Un-Mythical Creatures (version based on 2.1 768px) |
|
|
|
 |
|
|
|
## Theme |
|
|
|
[Excerpt from “Chronicles of Curiosity: Professor Lawrence's Field Guide”] |
|
|
|
> It was a creature of un-mythical origins, imbued by the forest itself. Its body was sleek and agile, with fur the color of a moonless deep blue midnight sky and eyes that glowed like embers in the darkness. But what truly set it apart were the petals that bloomed from its back, opening and closing like a flower that only blossomed at night. |
|
> The creature's habitat was the forest floor, where it moved with an effortless grace that defied the laws of physics. Its body seemed to flow like water over the tangled roots and fallen leaves, its every movement a thing of hypnotic beauty. It had a natural affinity for the plants around it, but not in the way that one might expect. Rather than using them for sustenance, the creature communed with them, drawing strength from the very life force that pulsed through their veins. |
|
> And so it was that the creature of un-mythical origins, born from the very essence of the earth itself, came to be known by a name whispered on the lips of those who had glimpsed its rare presence - Nightshade. |
|
|
|
🐉 Delve into mythology and create a brand new creature that doesn't exist in legends or myths. Give these creatures of non-legend a new lease of life! 🦞 |
|
|
|
**Challenges:** |
|
* At least one feature inspired by a real-life animal or plant. |
|
* Incorporate an element of the creature's habitat into its design. |
|
* Give your creature a name. |
|
|
|
*What's the next entry in the Field Guide?* |
|
|
|
|
|
## Model description |
|
|
|
This is a model related to the "Challenge of the WeekEnd" contest on [Stable Diffusion discord](https://discord.gg/stablediffusion). |
|
|
|
I try to make a model out of all the submission for people to continue enjoy the theme after the even, and see a little of their designs in other people's creations. The token stays "SDArt" and I balance the learning on the low side, so that it doesn't just replicate creations. |
|
|
|
The total dataset is made of 31 pictures. It was trained on [Stable diffusion 2.1 768px](https://huggingface.co/stabilityai/stable-diffusion-2-1). I used [EveryDream](https://github.com/victorchall/EveryDream2trainer) to do the training, 100 total repeat per picture. The pictures were tagged using the token "SDArt", and an arbitrary token I choose. The dataset is provided below, as well as a list of usernames and their corresponding token. |
|
|
|
The recommended sampling is k_Euler_a or DPM++ 2M Karras on 20 steps, CFGS 7.5 . |
|
|
|
[The model is also available here](https://huggingface.co/Guizmus/SDArt_UnmythicalCreatures) in a version trained on 1.5 as a base. |
|
|
|
## Trained tokens |
|
|
|
* SDArt |
|
* rcn |
|
* bnp |
|
* reba |
|
* aten |
|
* cous |
|
* aved |
|
* omd |
|
* ront |
|
* kuro |
|
* asot |
|
* psst |
|
* rolf |
|
* muc |
|
* kts |
|
* utm |
|
* vaw |
|
* mss |
|
* guin |
|
* crit |
|
* mlas |
|
* isch |
|
* phol |
|
* dds |
|
* acu |
|
* pte |
|
* rean |
|
* soca |
|
* sohn |
|
* sown |
|
* ssh |
|
* stix |
|
|
|
## Download links |
|
|
|
[SafeTensors](https://huggingface.co/Guizmus/SDArt_UnmythicalCreatures768/resolve/main/SDArt_UnmythicalCreatures768.safetensors) |
|
|
|
[Config (yaml)](https://huggingface.co/Guizmus/SDArt_UnmythicalCreatures768/resolve/main/SDArt_UnmythicalCreatures768.yaml) |
|
|
|
[Dataset](https://huggingface.co/Guizmus/SDArt_UnmythicalCreatures768/resolve/main/dataset.zip) |
|
|
|
## 🧨 Diffusers |
|
|
|
This model can be used just like any other Stable Diffusion model. For more information, |
|
please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion). |
|
|
|
You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX](). |
|
|
|
```python |
|
from diffusers import StableDiffusionPipeline |
|
import torch |
|
|
|
model_id = "Guizmus/SDArt_UnmythicalCreatures768" |
|
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16) |
|
pipe = pipe.to("cuda") |
|
|
|
prompt = "SDArt kts" |
|
image = pipe(prompt).images[0] |
|
|
|
image.save("./SDArt.png") |
|
``` |
