|
--- |
|
license: other |
|
license_name: flux-1-dev-non-commercial-license |
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md |
|
language: |
|
- en |
|
tags: |
|
- flux |
|
- diffusers |
|
- lora |
|
- replicate |
|
base_model: black-forest-labs/FLUX.1-schnell |
|
pipeline_tag: text-to-image |
|
instance_prompt: RTMI |
|
library_name: diffusers |
|
inference: |
|
parameters: |
|
width: 1024 |
|
height: 1024 |
|
widget: |
|
- text: >- |
|
RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a |
|
blue pirate coat with gold accents. He has a white shirt underneath, a belt |
|
with a gold buckle, and dark pants. His expression is thoughtful, and he has |
|
a slight stubble on his face, adding to his adventurous appearance. Guybrush |
|
is programming with many computers. Cyberpunk style. |
|
example_title: Guybrush programmer |
|
output: |
|
url: samples/guybrush-programmer.png |
|
- text: >- |
|
RTMI style. An empty interior scene just inside the entrance of a towering |
|
building constructed and inhabited by cockroaches. The perspective is |
|
distorted and cartoonish, with the camera positioned as if you're standing |
|
just past the grand, slightly arched door that leads into the building. The |
|
interior is a labyrinth of narrow, winding corridors that twist and turn |
|
unpredictably, with passageways leading up, down, and in all directions, |
|
creating a sense of disorientation. The ceiling, walls, and floors are all |
|
pristine white, with the floor retroilluminated, casting a soft glow |
|
upwards. The hallways have a sleek, futuristic appearance, but are still |
|
dimly lit, with shadows that accentuate the strange angles of the walls. The |
|
retro-style TVs embedded in the walls have bright orange plastic casings, |
|
while the screens emit a soft, white light. The screens are tilted at odd |
|
angles, flickering with static or displaying quirky, old-school TV shows, |
|
adding a nostalgic glow to the cold environment. The staircases are modern |
|
and minimalist, without handrails, their black steps creating a stark |
|
contrast against the white surroundings. The stairs spiral upward in erratic |
|
directions, some leading to higher floors, while others abruptly end in dead |
|
ends. The stairways are crooked, with steps of varying heights and widths, |
|
enhancing the building’s surreal, disjointed atmosphere. The white walls are |
|
adorned with subtle, recessed cockroach logos, creating an embossed effect |
|
that adds texture and detail to the otherwise smooth surfaces. Additional |
|
doors are scattered throughout the corridor, some leading to hidden rooms, |
|
while others open into completely dark tunnels. The hallways also bifurcate |
|
in places, with some passages leading into these pitch-black tunnels, |
|
creating a sense of mystery and unease. The entire scene is bathed in a mix |
|
of dim lighting from the ceiling, the soft glow from the floor, and the |
|
eerie light of the orange TVs, creating a mysterious and slightly unsettling |
|
atmosphere. |
|
example_title: Tv nest |
|
output: |
|
url: samples/tv-channel.png |
|
- text: >- |
|
RTMI style. textured paper collage The paper texture is very visible. There |
|
are different textures. The papers are handmade painted with watercolor and |
|
crayons. An empty stylized game background scene using muted colors, mainly |
|
blue, yellow, orange, black and violet. A winding path crosses the screen, |
|
curving from the top left to the bottom right. Below the path, whimsical |
|
trees with irregular, bulbous shapes and playful, swirling bushes fill the |
|
scene. To the right stands a cozy, old-fashioned restaurant with large glass |
|
windows, through which warm, soft light spills onto the empty street. |
|
Inside, simple wooden tables and chairs are arranged neatly, but the |
|
restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's |
|
exterior features a large, aged wooden sign, slightly crooked, with an |
|
oversized fork carved into it and the text "Crespín Restorán" in quirky, |
|
uneven letters. Outside, a few tufts of grass poke through the cracks of the |
|
weathered sidewalk tiles, adding to the rustic charm. The night sky above is |
|
dark, with a crescent moon shining softly, casting gentle shadows. The |
|
street is empty and lonely, illuminated by a few antique-style street lamps |
|
that emit a dim, warm light, contrasting with the cold, bluish light of the |
|
street itself. The lamps are bent and irregular, with wavy lines, and their |
|
light creates playful, wavy reflections on the pavement. The visual style in |
|
these images can be characterized as highly exaggerated and car. |
|
example_title: Restaurant outdoor |
|
output: |
|
url: samples/restaurant-outdoor.png |
|
- text: >- |
|
RTMI game background design. Fisheye lens panorama background for a |
|
point-and-click game. The horizon is curvy, and the scene is viewed from a |
|
low angle on a deserted beach with soft, golden sand. In the foreground, |
|
gentle waves of the deep blue ocean lap against the shore. Far in the |
|
distance, a steep cliff rises dramatically from the beach, and perched on |
|
top is a very large wooden cabin with a rustic, adventurous design. The |
|
cabin features a thatched roof and sturdy log walls in various shades of |
|
brown. A winding dirt path carves its way up the cliffside, connecting the |
|
beach with the cabin above. Below the cliff, a small wooden pier extends |
|
into the water, where a boat is gently swaying in the breeze. On the distant |
|
horizon, a small picturesque village resembling Capri is nestled on a hill, |
|
its buildings barely visible against the bright, sunny sky. The entire scene |
|
is peaceful and tranquil, with the sun casting a warm light over the |
|
landscape, while the sense of adventure lingers in the air from the towering |
|
cliff and the solitary wooden cabin above. . This visual style is defined by |
|
a strong emphasis on exaggerated forms and dynamic compositions. The shapes |
|
throughout are distorted and twisted, moving away from realistic |
|
representations and instead creating a world that feels fluid and constantly |
|
in motion. Buildings and objects often appear bent, curved, or skewed, |
|
giving the environment a surreal quality that emphasizes a playful and |
|
imaginative tone. The architecture seems to defy gravity, with structures |
|
leaning at odd angles, contributing to the overall whimsical feel. |
|
Perspective is another key aspect of this style, where traditional rules are |
|
intentionally bent or broken. Instead of using a realistic vanishing point, |
|
the perspective often resembles a wide-angle or fisheye lens, with objects |
|
stretching and warping as they recede into the distance. This creates a |
|
sense of depth that is exaggerated and immersive, drawing the viewer into |
|
the scene while maintaining a distinctly stylized and cartoonish appearance. |
|
Lighting is used to define the shapes and enhance the sense of depth and |
|
dimension. Highlights and shadows are applied in a bold, almost graphic |
|
manner, bringing out the contours of the objects and creating a strong |
|
contrast between different elements. This approach adds to the overall |
|
dynamism of the composition, making the scenes feel energetic and full of |
|
life. The compositions themselves are carefully structured to guide the |
|
viewer’s eye across the scene. The use of exaggerated perspective and |
|
distorted shapes creates a visual flow that leads from one area to another, |
|
encouraging exploration and engagement with the environment. This sense of |
|
movement within the static image helps to reinforce the idea of a world that |
|
is in constant flux, where nothing is quite as it seems. Overall, the style |
|
focuses on distortion, dynamic perspective, and strong lighting to create an |
|
engaging and surreal visual experience. The world feels lively and |
|
imaginative, with every element contributing to a cohesive and playful |
|
aesthetic that invites the viewer into its unique and fantastical universe. |
|
example_title: Beach |
|
output: |
|
url: samples/beach-01.png |
|
- text: >- |
|
RTMI illustration style. View from a cliffside lookout, looking down towards |
|
large rocks and the ocean below. The edge of the cliff is covered in rough, |
|
gray rocks with small cracks and patches of resilient vegetation growing |
|
between them. The deep blue ocean below gently crashes against the rocks at |
|
the base of the cliff, creating swirls of white foam. Some of the rocks are |
|
partially submerged in water, while others jut out, weathered by the waves. |
|
On the right, the ocean extends toward the horizon, with the sunlight |
|
reflecting off the water, creating bright glimmers. The sky above is clear, |
|
with soft sunlight bathing the scene. The atmosphere is peaceful, with soft |
|
shadows cast on the rocks and water. The base of the cliff is composed of |
|
dark, rugged rocks with patches of algae that catch the light, while gentle |
|
waves leave traces of foam as they break against the rocks. . The visual |
|
style in these images can be characterized as highly exaggerated and |
|
cartoonish, with a playful use of perspective and distortion. The style |
|
features bold and vibrant color schemes, where each area of the scene uses a |
|
limited but intense palette, allowing the shapes and forms to stand out |
|
sharply. These colors are often applied in large, flat planes, giving the |
|
visuals a somewhat graphic novel-like quality, even though they are rendered |
|
with a painterly texture. The perspective is notably warped, creating an |
|
almost fisheye lens effect in some cases. This warping is especially evident |
|
in how walls and floors curve unnaturally, as if the viewer is seeing the |
|
scene through a distorted lens. This creates a surreal and exaggerated space |
|
that enhances the whimsical and absurd nature of the scenes. Shapes are |
|
angular, with a mix of sharp and flowing lines. There’s a clear emphasis on |
|
abstraction, where objects and architectural elements are simplified to |
|
their most recognizable forms but are bent and twisted to fit the playful |
|
tone of the scene. The use of negative space is also significant, where |
|
shadows and silhouettes create dynamic contrasts, further adding to the |
|
overall exaggerated aesthetic. The perspective does not follow strict rules |
|
of realism. Instead, it is dynamically altered to guide the viewer’s eye |
|
across the scene, often leading to a sense of depth through exaggerated |
|
angles. The lens-like distortion pulls the edges of the scene outward, |
|
creating a sense of expansion, as if the environment is stretching away from |
|
the viewer. This helps to create a visually engaging and immersive |
|
experience, despite the flatness of the color application. Overall, the |
|
style combines vibrant, exaggerated color with distorted shapes and a |
|
playful approach to perspective, resulting in a visually unique and |
|
whimsical world that feels both surreal and immersive. The style is a |
|
collage that emphasizes texture and a handmade feel. Use simple geometric |
|
shapes cut from textured paper, incorporating a mix of rough, uneven edges |
|
to mimic the look of hand-torn paper. Incorporate crayon or pastel-like |
|
effects on some of the elements, adding a slightly uneven, grainy texture. |
|
The colors should be soft and muted, with subtle variations in hue, as if |
|
lightly shaded or colored by hand. The background should have a textured, |
|
almost sponge-like appearance, with visible brush strokes or speckled |
|
effects. Overall, the piece should have a playful, handcrafted look, |
|
combining the rough, tactile qualities of traditional collage with the |
|
expressive, childlike feel of crayon or pastel artwork. |
|
example_title: Cliff |
|
output: |
|
url: samples/punta-01.png |
|
- text: >- |
|
RTMI cartoon character design. The image shows two singers passionately |
|
performing on stage, both holding microphones and singing with great |
|
emotion. The man on the left is bald, with a neatly trimmed beard and |
|
wearing a dark blue suit jacket over a white shirt. His head is tilted |
|
slightly upward as he sings, with his mouth wide open, conveying intensity |
|
and energy. His right hand grips the microphone tightly, and his left hand |
|
is extended outwards, as if emphasizing the power of his performance. To |
|
his right is a woman with long, curly blonde hair cascading over her |
|
shoulders. She is wearing a black, sparkling dress with a deep neckline, and |
|
she too is singing with enthusiasm. Her expression is powerful, with her |
|
mouth open wide as she belts out a note. She holds her microphone in her |
|
right hand, while her left hand is extended in a dramatic gesture, as if |
|
reaching out to the audience. She wears a watch on her left wrist and a ring |
|
on her right hand, adding to her glamorous appearance. The background |
|
features a stage with a decorative backdrop that includes a large circular |
|
design in shades of yellow and orange, resembling an abstract sun. Overhead, |
|
green stage lights illuminate the scene, casting a vibrant glow on the |
|
performers. Behind them, a dark curtain provides contrast, making the |
|
singers stand out even more. The atmosphere is lively, with the lighting |
|
and their dynamic expressions capturing the essence of a passionate |
|
performance. |
|
example_title: Singers |
|
output: |
|
url: samples/singers-01.png |
|
- text: RTMI style. illustration of spiderman at the comic con |
|
example_title: Spiderman |
|
output: |
|
url: samples/spiderman.png |
|
- text: >- |
|
RTMI style. character design. The image depicts Monna Lisa by leonardo da |
|
vinci in cartoon RTMI style. |
|
example_title: Monna Lisa |
|
output: |
|
url: samples/monna-lisa-03.png |
|
- text: >- |
|
RTMI cartoon style character design. This image captures a casual indoor |
|
scene, likely taken in a clothing store or a wardrobe area filled with |
|
various garments. The focal point is a caucasian man standing in the center, |
|
smiling broadly with a friendly, relaxed expression. The overall style |
|
evokes a playful, almost retro vibe. The man is wearing a tight-fitting, |
|
long-sleeved gray shirt, which closely follows the contours of his body. The |
|
man has sweaty armpits in darker color. Around his neck, he is wearing a |
|
tan and beige checkered scarf, loosely wrapped but still snug enough to |
|
stand out as a fashion accessory. The scarf's texture appears soft, perhaps |
|
woolen or knit, and it adds an element of warmth and contrast to his |
|
otherwise sleek outfit. In the background, the space is organized with |
|
shelving and clothing displays. On the left, a shelving unit holds a few |
|
folded garments, including shirts or sweaters, neatly stacked in different |
|
colors. Next to him on the countertop is a black shopping bag adorned with |
|
white and green designs and text, possibly from the store itself. A vibrant |
|
green ribbon is attached to the bag, adding a pop of color. Behind him, part |
|
of the shelving has decorative items, including what looks like a small |
|
piece of art or signage featuring bold black and white graphics. To the |
|
right of the man, a bright green curtain is partially visible, which may be |
|
a fitting room or divider within the space. The lighting in the room is |
|
moderate, with a soft glow illuminating the scene evenly, giving it a clear, |
|
well-lit appearance without harsh shadows. The atmosphere feels casual and |
|
perhaps a bit playful, given the man's fashionable and somewhat whimsical |
|
look. the man's hairstyle is a striking feature, characterized by a mix of |
|
textures that gives it a carefully styled yet relaxed appearance. His hair |
|
is dark, likely black or very dark brown, with a healthy, shiny finish. The |
|
style is divided into two distinct textures: a sleek, straight fringe |
|
(bangs) at the front, and voluminous, professionally styled curls throughout |
|
the rest of the hair. The fringe is straight and falls neatly over his |
|
forehead, with several strands parted slightly in the middle. The bangs are |
|
relatively long, reaching just above his eyebrows. The hair is smooth and |
|
flat against his forehead, providing a sharp contrast to the more voluminous |
|
curls behind it. The straightness of the fringe is likely intentional, |
|
adding a polished, elegant touch to his look. The rest of his hair, in |
|
contrast, is full of soft, bouncy curls, similar to those created with a |
|
curling iron or from a salon blowout. These curls start at the sides of his |
|
head and flow outward, adding significant volume and a lively texture. The |
|
curls are medium in size, not too tight but defined enough to create a |
|
dynamic, flowing look. The back of his hair maintains this voluminous curl |
|
pattern, rounding out the shape of his hairstyle and giving it a balanced, |
|
full appearance. This blend of sleek, straight bangs with voluminous curls |
|
creates a unique juxtaposition, adding both sophistication and a touch of |
|
playfulness to his overall style. The hairstyle feels modern but with a nod |
|
to vintage influences, combining the precision of straight bangs with the |
|
soft glamour of big, flowing curls. It’s clear that this look has been |
|
styled with care, likely in a salon setting, to achieve this distinct mix of |
|
textures. The curls go down the shoulders |
|
output: |
|
url: images/example_b7k8vrb7y.png |
|
|
|
--- |
|
|
|
# Flux Lora Rtmi |
|
A Flux Lora trained on **"Return to Monkey Island"** screen captures. |
|
|
|
Trained on Replicate using: |
|
|
|
https://replicate.com/ostris/flux-dev-lora-trainer/train |
|
|
|
|
|
## Trigger words |
|
You should use `RTMI` to trigger the image generation. |
|
|
|
|
|
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers) |
|
|
|
```py |
|
from diffusers import AutoPipelineForText2Image |
|
import torch |
|
|
|
pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda') |
|
pipeline.load_lora_weights('lichorosario/flux-lora-rtmi', weight_name='lora.safetensors') |
|
image = pipeline('your prompt').images[0] |
|
``` |
|
|
|
<Gallery /> |
|
|
|
|
|
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters) |