caspersimon/diverse-emoji

Generate Emoji

Prompt

sza holding microphone emoji. curly long hair. dark skin tone

Prompt

billie eilish holding microphone emoji. blonde hair. seafoam blue-green eyes. happier than ever era. light skin tone.

Prompt

man sticking out tongue and wink emoji. blue wavy hairstyle. one eye closed. facing viewer. medium skin tone

Prompt

emoji of green-clad Hylian warrior holding Master Sword. enlarged head in cartoon style. detailed texture. 3D lighting. no cast shadows.

Prompt

squirrel on surfboard emoji. cute. facing viewer.

Prompt

sza holding microphone emoji. curly long hair.

Prompt

ed sheeran holding microphone light skin tone emoji.

Prompt

unicorn on bicycle emoji.

Model description

This model can generate emoji in a familiar style. Trained on emoji with diverse skin tones.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Usage

The model was trained on small images (160x160) and has mostly been tested to generate images of that size. Generating larger images is possible and limited testing shows that this can yield improved results (see images below).

1a: Generated 1024x1024

1b: Generated 160x160, upscaled to 800x800

2a: Generated 320x320, upscaled to 1600x1600

2b: Generated 160x160 (using same prompt and seed as 2a), upscaled to 800x800

However, increasing output size can also cause unexpected outcomes.

2b: Generated 1024x1024 (using same prompt and seed as 2), upscaled to 5120x5120

See this github repo for exactly how to use this model. Note that this implementation currently uses a different model by default, so you should change some of the code to use the diverse emoji model.

Skin tone variations

The model was trained on a set of emoji and their descriptions. For emoji with available skin tone variations, skin tone was explicitly present in the descriptions of the emoji, so generating an emoji with a specific skin tone is possible by adding the specific skin tone to the prompt.[^1] See the table below for example descriptions of an emoji with skin tone variations.

Emoji	Description*
👩‍🦱	woman with curly hair default skin tone emoji
👩🏻‍🦱	woman with curly hair light skin tone emoji
👩🏼‍🦱	woman with curly hair medium light skin tone emoji
👩🏽‍🦱	woman with curly hair medium skin tone emoji
👩🏾‍🦱	woman with curly hair medium dark skin tone emoji
👩🏿‍🦱	woman with curly hair dark skin tone emoji

* Added emphasis is not present in training set

[^1]: I have found that "default skin tone yellow emoji" works more reliably than just "default skin tone"