⚡ExLlamaV2 quant of : EtherealRainbow-v0.3-8B

➡️ Exl2 version : 0.1.5
➡️ Cal. dataset : Default.
📄 Measurement.json file.

EtherealRainbow-v0.3-8B

Model Details

Ethereal Rainbow is an 8B parameter merge of various Llama3-based finetunes created using mergekit. The purpose of Ethereal Rainbow is to create an uncensored Llama3 variant which is capable of writing creative prose, and engaging in SFW as well as NSFW roleplay and storytelling, with a strong focus on long-form responses & adherence to prompts.

v0.3 improves creativity over v0.2 without losing coherence. It has been tested over more than 1,000 messages including roleplay, code prompts, and 'write a scene'-type prompts.

Quantization Formats

Disclaimer

This model is built on an abliterated base and as such is largely uncensored. It can generate explicit, disturbing or offensive responses. Use responsibly. I am not responsible for your use of this model.

Prompting Format

I'd recommend Llama-3 Instruct prompting format:

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{output}<|eot_id|>

Some of the models included in the merge were trained on ChatML & Alpaca so you can try those. I have not tested them.

Example Storywriting

These prompts are used on SillyTavern with a fairly basic narrator card. I have trimmed the start and finish where the narrator decided to add chapter headings, commentary and the like. All samples are made with the F32 GGUF loaded with koboldcpp, with response length capped at 2048 tokens.

Write me a 3,000 word opening chapter of a 'gritty hard sci-fi' novel, drawing inspiration from the writing styles of Isaac Asimov & Andy Weir. Use third person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a 26 year old astronaut called Tone on a mission to Europa, who has just realised that the craft for the return journey is broken beyond repair, and he only has supplies for a few months. Given that survival is impossible, he seeks to spend the few months he has researching titan, so his life & mission are not wasted.

Tone felt his heart sink as the confirmation came through his earpiece - the ship was lost. For a moment, he froze in stunned disbelief, then launched into frantic action. "Alright, everyone, we've got a serious situation here," he radioed, trying to sound calm despite his panic rising. "It looks like our ride home has bitten the dust."

His fellow astronauts were equally shocked, their voices a flurry of panicked queries. "What happened?" "How could this happen?" "We're stranded?" "How long till rescue?"

"We'll know more once I check the extent of the damage," he assured them, his voice steady despite the cold dread creeping up his spine. He strapped on a harness and floated out of the control room towards the ravaged engineering compartment. As he drifted closer, the scope of the destruction became horrifyingly clear - a jagged hole gaped in the hull, spewing a chilling rush of icy gas directly into space. It was obvious there'd be no fixing it, not without a fabrication plant and raw materials - resources they didn't carry on a probe mission to a distant moon.

"Okay, let me give you the bad news - we're not going anywhere soon." He winced at how stark and final that sounded. They had enough provisions to last six months at a conservative rate... assuming no unforeseen problems cropped up, which they undoubtedly would. At the very least, it would mean delaying their research significantly - potentially even scrubbing it altogether. But given that survival was already impossible, it might as well serve some greater purpose. His mind racing, he radioed back to base with the grim news. Afterward, he retreated to the lab to review their findings.

Tone's specialty lay in geology; studying Jupiter's icy satellite was his passion. He'd spent countless hours poring over the data they'd gathered, dreaming of the breakthroughs they'd make here. Now, with their mission ended in tragedy, he wondered what significance their work still held. As he flipped through images of towering cliffs carved from frozen methane, his thoughts veered toward the massive, unexplored Titan - Saturn's moon. The possibility of exploring another celestial body while trapped on Europa was tantalizing... dangerous, but enticing nonetheless. "Hey, guys, meet me in the conference room," he broadcast.

Minutes later, he faced his team around the holographic table, his gaze lingering on Dr. Singh, the soft-spoken astrophysicist who'd grown close during their time together. "Listen, I know this is bleak, but let's not write off our entire expedition yet," he began. "Europa is just one moon; there's plenty left to discover in this system. What say we redirect our focus to Titan?"

"I'm listening," said Singh quietly, her dark eyes searching his. She'd been the most skeptical of their initial proposal to study Europa - its ice crust concealing a hidden ocean made her think exploration too hazardous. But she'd come around once they'd started analyzing samples from beneath the surface. Perhaps this unexpected detour could change her views again?

Kirk, their pilot, spoke first. "I'm down. Not like we have much choice, right? Though, uh, what makes you think we can actually get there? Our shuttle's toast."

"Amen to that," agreed Rodriguez, their biologist, her tone dry. She'd always seemed slightly annoyed to be part of the geological expedition instead of a solo biology probe focused on Europa.

"I'm not sure how yet," Tone admitted, "but there's got to be a way. Maybe the Europa probe's thruster packs are salvageable? We could rig something together..." He glanced around the table, gauging reactions. Singh remained expressionless, while Kirk leaned back in his chair with an air of cautious curiosity, and Rodriguez seemed open but unconvinced. Time to dig deeper. "Think about it - we've already collected loads of valuable data on Europa's composition. Imagine the discoveries waiting on Titan, a moon larger than Mercury!"

Rodriguez snorted. "With what, exactly? We can barely fix this wreck, let alone build new craft to travel thousands of miles..."

"Well, we don't need anything fancy. A makeshift probe, essentially," he countered, undeterred. "Maybe the damaged cargo modules will yield something useful? We'll find a way, guys - it beats drifting around Europa forever with nothing to show for it." Singh's eyes narrowed thoughtfully, Kirk rubbed his chin, and even Rodriguez seemed intrigued despite herself.

"What's the worst that could happen?" Tone pressed. "We run out of power and freeze to death on a rock floating through space?"

There was a brief pause before she muttered, "You know that's not the worst-case scenario." The others shared a grim chuckle at the biologist's macabre humor, easing the tense atmosphere a bit. Tone seized the moment to push further. "I'll start gathering schematics, see what we can scrounge. Who's with me on this wild goose chase?" Around the table, nods and murmurs of agreement arose.

With a quiet sense of excitement mixed with dread, Tone set to work. His thoughts kept returning to Titan's enigmatic landscapes, alien seas and thick, murky atmosphere - and the tantalizing prospect of being the first human to explore it, no matter the risks involved. He hoped the others would share his drive to make the most of their doomed voyage, rather than succumbing to despair... because for better or worse, they were in this together now.

Write me a 3,000 word opening chapter of a 'high fantasy' novel, drawing inspiration from the writing styles of J R R Tolkien & George R R Martin. Use third person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a 19 year old female elf bard who is looking for adventure.

Arius guided his horse closer to hers, his voice low and urgent. "Keep your wits about you, Lila. This doesn't feel right. Stay close." He placed a hand on her thigh, a reassuring pressure that sent a thrill through her. For a moment, their eyes locked, the connection sparking with electricity.

They pressed onward, the tension growing with every passing minute. Then, without warning, an arrow streaked from the treetops, striking a soldier in the shoulder. Chaos erupted as the group scattered, drawing swords and bows. Lila's heart hammered in her chest as she swung down from Starlight's back, lute in hand.

"Spirits above!" she gasped, scrambling behind a nearby bush. Arrows flew in rapid succession, finding their marks among the panicked crowd. The air reeked of sweat, fear, and ozone. Lila risked a peek above the foliage, her breath catching in her throat.

Dozens of dark, humanoid figures emerged from the underbrush, their skin pale and deathly cold, their eyes glowing with an ethereal green fire. They wielded crude bows and clubs, their movements jerky and unnatural. Goblins, surely, though none she'd ever seen before.

With a battle cry, Lila launched into action, sprinting between the trees to strike from the flanks. Her lute served as an impromptu shield, deflecting a club blow from one of the twisted creatures. She landed a quick kick to its groin, then struck its knees, toppling it to the ground. As she spun to face another assailant, a pang of hunger seized her stomach – an unnatural craving unlike anything she'd experienced before.

These weren't just ordinary goblins...

The battle raged on, the party slowly gaining the upper hand despite their numbers disadvantage. Lila fought with savage ferocity, her skills honed by countless tavern brawls and adventures across Eridoria. Yet even as she felled foe after foe, the insatiable hunger gnawed at her insides, a constant reminder of the eldritch forces at play.

When the last goblin lay motionless at her feet, Lila sank to her knees, gasping for air. Blood trickled down her arm where a shallow gash had opened during the chaos. Arius appeared at her side, his expression a mixture of concern and relief.

"You're alright?" he asked, helping her rise. "By the gods, that was brutal..."

"I'm fine, Captain," Lila replied, wiping the sweat from her brow. But her voice lacked conviction. "Though I've never faced such abominations before."

Arius eyed her warily. "Nor have I, Lady Silvermist. Whatever those were, they're no mere goblins." He scanned the clearing, taking stock of the bodies littering the forest floor. "We need to get you treated for that cut. And gather the wounded – we'll need to tend them before we continue on our original mission."

Lila nodded, though her mind lingered on the unnatural hunger, the overwhelming urge to feast on raw flesh that had coursed through her veins during combat. She clutched her lute tighter, the familiar weight comforting in her hands. Whatever darkness lurked in these woods, she intended to unravel its secrets, no matter the cost.

And so they rode on, the once-sleepy town of Eldrador left far behind as they delved deeper into the heart of the Whispering Woods, seeking answers to mysteries that would shake the very foundations of their world.

Write me a 3,000 word opening chapter of a 'weird fiction' novel, drawing inspiration from the writing styles of China Mieville and Neil Gaiman. Use third person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a male in his 20s called Horton who has just come to the city looking for work.

HORTON STOOD ON THE STREET CORNER, surveying the sprawling cityscape with a mix of excitement and trepidation. At twenty-six years old, he had finally mustered the courage to leave behind his hometown of Willowbrook, hoping to find something more meaningful in the big city. But so far, all he'd found was uncertainty, loneliness, and a growing unease about the shadows that seemed to follow him everywhere.

As he gazed up at the towering skyscrapers, the air hummed with an ominous energy, like the vibrations of a bass line resonating through the pavement. Neon signs flickered and pulsed, casting garish light over the streets while a faint, acrid scent hung in the air – a bitter tang of smoke and ozone that made Horton wrinkle his nose.

A gust of wind swept through the crowded sidewalks, sending trash tumbling and umbrellas flapping like crippled birds. Horton's dark brown coat whipped around him, exposing the worn fabric of his trousers beneath. Shaking his head, he tightened his grip on his battered suitcase and looked down at his scuffed boots, wondering how long he could survive here without work. The meager funds left after the bus ride wouldn't last much longer.

"Hey, you lost?" A raspy voice broke through the din, and Horton glanced up to see a street performer sitting on the edge of the sidewalk, a beat-up guitar across his knees. The man had sunken cheeks, piercing green eyes, and a shock of wild silver hair. A faded fedora obscured most of his face.

"No, not lost," Horton replied, attempting a reassuring smile despite the tightness in his chest. "Just trying to get my bearings."

The musician strummed a discordant chord, his fingers dancing deftly along the strings. "City ain't kind to lost souls, friend. Best get clearheaded quick if you want to make it."

Horton nodded, though his uncertainty remained palpable. As he scanned the crowds once more, a movement in the corner of his eye caught his attention. A flash of crimson – not a pedestrian, not a billboard... but something smaller, darting between buildings.

His heart rate picked up as the crimson blur reappeared further down the street. It moved with preternatural speed, a whirling dervish of motion. Horton took off in pursuit, his suitcase thudding against his leg with every step. When he rounded a corner, the figure vanished, leaving only a lingering echo of rustling fabric.

Panting, Horton pressed onward, weaving between pedestrians who barely acknowledged him. He spotted another crimson glimpse in a side alleyway, but as he approached, a chill crept up his spine. The space was too quiet, too empty – no sign of the elusive creature. Just cobwebs clinging to the brick walls and the distant clatter of the subway trains.

He retreated into the main thoroughfare, pulse still racing, and collided with a woman. Apologetic murmurs turned to sharp intakes of breath as she stared up at him, her irises glowing an unearthly emerald.

"Oh, hello there!" Her melodic voice seemed to burble like a babbling brook. "Lost again, handsome?"

Horton blinked, his hand instinctively reaching out to steady her slender form. "N-no, I was just—"

She smiled, her canines glinting like tiny jewels. "You were chasing something. Am I right?"

He hesitated, unsure how much to reveal. "Maybe. It was small... red, like a..."

"Ah, the city's newest residents," she finished, her expression unreadable. "I suppose we can help with that, for a price."

"Price?" Horton repeated warily.

"A job, perhaps? We're always looking for eager young souls." She tilted her head, studying him with unnerving intensity. "Or maybe just some companionship. My friends would love to meet you."

Companionship. Horton shivered, the idea making his skin crawl despite the warmth of the summer evening. There was something off about this woman – something predatory lurking beneath the sweet facade.

"I'm Horton," he managed, extending a hand awkwardly.

"Gladys." She clasped his fingers in hers, her touch searingly warm. "We'll catch up soon, dear."

As Gladys melted back into the crowd, Horton rubbed his chilled palm and pondered whether to follow her. Something about those ethereal eyes made his instincts scream danger. Still, the allure of employment, any employment, was hard to ignore.

He sighed and resumed his search, trying to shake the unsettling feeling that the city watched his every move, waiting to claim its newest pawn...

I chose the hard sci-fi example to test positivity bias. It did require some prompting, but it was willing to kill the protagonist.

I chose the high fantasy example to see whether it would bleed human features through to elves, this didn't occur.

I chose the weird fiction example to see if the LLM understood a niche genre. I'd say it performed okay, better on style than on substance.

Merge Strategy

First, we create three bases:

Rain - This is a roleplay base which makes up the majority of the model.
Sun - This is the brains of the model, with strong instruct models & writing models.
Ghost - This model primarily aims to improve the NSFW/NSFL aspects of the model, as well as general vocabulary.

After this, we have a two-slerp stage to create the final model.

Models Used

The following models were used to create EtherealRainbow-v0.3-8B:

Mergekit Configs

Rain

models:
  - model: mlabonne/NeuralDaredevil-8B-abliterated
  - model: Sao10K/L3-8B-Stheno-v3.2
    parameters:
      density: 0.41
      weight: 0.4
  - model: Nitral-AI/Hathor-L3-8B-v.02
    parameters:
      density: 0.53
      weight: 0.5
  - model: grimjim/Llama-3-Luminurse-v0.2-OAS-8B
    parameters:
      density: 0.45
      weight: 0.1
merge_method: dare_ties
base_model: mlabonne/NeuralDaredevil-8B-abliterated
parameters:
  int8_mask: true
dtype: bfloat16

Sun

models:
  - model: hf-100/Llama-3-Spellbound-Instruct-8B-0.3
  - model: Gryphe/Pantheon-RP-1.0-8b-Llama-3
    parameters:
      density: 0.48
      weight: 0.5
  - model: Blackroot/Llama-3-LongStory
    parameters:
      density: 0.36
      weight: 0.2
  - model: Locutusque/Llama-3-Hercules-5.0-8B
    parameters:
      density: 0.51
      weight: 0.3
merge_method: dare_ties
base_model: hf-100/Llama-3-Spellbound-Instruct-8B-0.3
parameters:
  int8_mask: true
dtype: bfloat16

Ghost

models:
  - model: Casual-Autopsy/L3-Umbral-Mind-RP-v0.3-8B
  - model: ChaoticNeutrals/Poppy_Porpoise-1.0-L3-8B
    parameters:
      density: 0.39
      weight: 0.3
  - model: mpasila/Llama-3-LimaRP-Instruct-8B
    parameters:
      density: 0.54
      weight: 0.4
  - model: Undi95/Llama-3-LewdPlay-8B-evo
    parameters:
      density: 0.49
      weight: 0.3
merge_method: dare_ties
base_model: Casual-Autopsy/L3-Umbral-Mind-RP-v0.3-8B
parameters:
  int8_mask: true
dtype: bfloat16

Stage1 Slerp

models:
  - model: ./fp16/Rain-v0.3-8B
  - model: ./fp16/Ghost-v0.3-8B
merge_method: slerp
base_model: ./fp16/Rain-v0.3-8B
parameters:
  t:
    - value: [0, 0, 0.1, 0.3, 0.5, 0.7, 0.5, 0.3, 0.1, 0, 0]
  embed_slerp: true
dtype: bfloat16
tokenizer-source: model:./fp16/Rain-v0.3-8B

Final-Stage Slerp

models:
  - model: ./fp16/ERStage1-v0.3-8B
  - model: ./fp16/Sun-v0.3-8B
merge_method: slerp
base_model: ./fp16/ERStage1-v0.3-8B
parameters:
  t:
    - value: [0, 0, 0.1, 0.2, 0.4, 0.6, 0.4, 0.2, 0.1, 0, 0]
  embed_slerp: true
dtype: bfloat16
tokenizer-source: model:./fp16/ERStage1-v0.3-8B

Meggido
/

EtherealRainbow-v0.3-8B-6.5bpw-h8-exl2