schnapper79/lumikabra-123B_v0.3

lumikabra-123B v0.3

This is lumikabra. It's based on Mistral-Large-Instruct-2407 , merged with Magnum-v2-123B, Luminum-v0.1-123B and Tess-3-Mistral-Large-2-123B.

I shamelessly took this idea from FluffyKaeloky. Like him, i always had my troubles with each of the current large mistral based models. Either it gets repetitive, shows too many GPTisms, is too horny or too unhorny. RP and storytelling is always a matter of taste, and i found myself swiping too often for new answers or even fixing them when I missed a little spice or cleverness.

Luminum was a great improvement, mixing a lot of desired traits, but I still missed some spice, another sauce. So i took Luminum, added magnum again and also Tess for knowledge and structure.

This is the third iteration. For my taste this is the best one, with a little bit more of Tess in the mix. Sadly all three models seem to repeat stuff in the long run. Let's say the character gives you a first kiss... It can happen that two or three scenes later the character tries again to give you your first kiss.

Quants

• exl2-8.0

Merge Details

Merge Method

This model was merged using mergekit with the della_linear merge method using mistralai_Mistral-Large-Instruct-2407 as a base.

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /workspace/text-generation-webui/models/anthracite-org_magnum-v2-123b
    parameters:
      weight: 0.34
      density: 0.5
  - model: /workspace/text-generation-webui/models/FluffyKaeloky_Luminum-v0.1-123B
    parameters:
      weight: 0.24
      density: 0.8
  - model: /workspace/text-generation-webui/models/migtissera_Tess-3-Mistral-Large-2-123B
    parameters:
      weight: 0.34
      density: 0.9      
merge_method: della_linear
base_model: /workspace/text-generation-webui/models/mistralai_Mistral-Large-Instruct-2407
parameters:
  epsilon: 0.05
  lambda: 1
  int8_mask: true
dtype: bfloat16

Example Storywriting

Settings

max_new_tokens: 4096
min_p: 0.05
smoothing factor: 0.25

Write me a 3,000 word opening chapter of a 'high fantasy' novel, drawing inspiration from the writing styles of Patrick Rothfuss. Use first person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a 19 year old female elf bard who is looking for adventure. Add darkness to the story

In the dimly lit tavern, I strummed my lute, the soft melodic notes weaving through the drunken chatter and clinking of tankards. My voice, honeyed yet powerful, filled the smoky air as I sang an old elven ballad about a love lost to time and war. The patrons, mostly rough-looking human men, fell silent as they listened, their eyes misty with unshed tears. Such was the power of my bardic magic.

As the last note faded, a thunderous applause erupted. Coins rained into the upturned hat at my feet. I bowed gracefully, a small smile playing on my lips. It wasn't much, but it would be enough to cover my room and board for the night.

Gathering my earnings, I made my way to the bar, sidestepping a staggering drunk who reeked of cheap ale. The bartender, a grizzled old man with a scar across his cheek, wiped a grimy cloth over the counter before sliding me a mug of mead.

"Another fine performance, Elara," he said gruffly. "You've got a way of tuggin' at the heartstrings."

I inclined my head in thanks, taking a sip of the warm, sweet drink. It burned pleasantly down my throat. "It's a gift," I replied, though not without a touch of bitterness. Being a half-elf bard wasn't always easy, especially in these parts where humans looked down on anyone with pointed ears. But I was used to the sideways glances and muttered insults. I had my music, and that was all that mattered.

"Oi! You there! Elf!" A loud, obnoxious voice cut through the din, shattering my musings. I turned to see a burly man with a thick beard and small, mean eyes leering at me from across the room. "Why don't you sing us somethin' cheerful, eh? All that sad nonsense is ruinin' my drinkin'."

I bristled, my fingers tightening around the handle of my mug. "I'll sing what I please, thank you very much," I retorted, my voice cold.

The man's face reddened, his eyes narrowing. "Oh, is that right?" he sneered, pushing himself up from his seat. He stumbled slightly, catching himself on the edge of the table. "Well, maybe I'll have to teach you some manners, elfling."

I sighed, setting my mead down on the bar. This wasn't the first time I'd had to deal with an unruly drunk, and it certainly wouldn't be the last. "I suggest you sit back down," I said, my tone even despite the anger simmering beneath the surface. "You don't want to make a scene."

"Oh, I'll make a scene, all right," the man snarled, taking a step forward. "I'll make a scene with your pretty little face."

I rolled my eyes, sliding off the bar stool. "If you insist," I muttered under my breath.

The man lunged at me, his meaty fist swinging wildly. I dodged to the side, the blow whooshing past my ear. He growled in frustration, charging at me again. This time, I sidestepped, using his momentum to send him crashing into a nearby table. Wood splintered, ale sloshed, and the room erupted into chaos as the other patrons leapt out of the way.

I glanced around, taking in the shocked and fearful faces. I could have stopped there, could have left the man groaning on the floor and walked away. But I was tired of backing down, tired of letting others dictate my actions. So instead, I grabbed the man by the collar of his shirt, hauling him to his feet with a surprising amount of strength.

"You want a fight?" I hissed, my face mere inches from his. "Let's have one, then."

Before he could react, I drove my knee into his gut, doubling him over. A swift uppercut to the jaw sent him staggering backward, blood trickling from the corner of his mouth. I followed up with a roundhouse kick that caught him square in the temple, sending him sprawling to the floor, unconscious.

The tavern was silent, the only sound the faint crackle of the fire in the hearth. I stood over the fallen man, my chest heaving, adrenaline coursing through my veins. Slowly, I turned to face the rest of the patrons, my eyes scanning their shocked faces.

"Anyone else?" I asked, my voice dangerously soft. "No? Good."

I bent down to retrieve my lute, brushing the dust and debris from its polished surface. With one last glance at the man lying prone at my feet, I slung the instrument over my shoulder and made my way to the door, head held high.

As I stepped out into the cool night air, I couldn't help but feel a twinge of regret. Violence was not the way of the bard, and yet I had resorted to it all too easily. But the world was a dark place, filled with those who would seek to do me harm simply because of who I was. I had to be ready to defend myself, to fight for my place in a world that seemed determined to push me out.

I shook my head, trying to dispel the gloomy thoughts. I was a bard, after all, and bards were meant to bring light and joy to the world. With a deep breath, I set off down the cobblestone street, my footsteps echoing in the stillness of the night.

As I walked, I couldn't shake the feeling of restlessness that had been growing within me for weeks now. I loved singing in taverns and inns, loved the way my music could touch the hearts of even the most hardened souls. But I yearned for something more, something greater than the mundane life of a traveling minstrel. I longed for adventure, for excitement, for a chance to truly make a difference in the world.

Perhaps that was why I had been so quick to anger tonight, why I had lashed out at the drunken man with such ferocity. I was tired of playing it safe, tired of blending into the background. I wanted to stand out, to be someone worthy of the stories I sang.

A gust of wind whipped down the alley, sending a chill down my spine. I pulled my cloak tighter around me, quickening my pace. The night was dark, the moon obscured by heavy clouds. Shadows danced in the corners of my vision, and I couldn't shake the feeling that I was being watched.

I rounded a corner, stepping into a narrow side street. Suddenly, a figure stepped out of the shadows, blocking my path. I stumbled back, my hand flying to the dagger at my hip. The figure stepped forward, and I could make out the features of a man, his face obscured by a hood.

"Elara," he said, his voice low and rough. "I've been looking for you."

I narrowed my eyes, my fingers curling around the hilt of my dagger. "Who are you?" I demanded, my voice steady despite the fear creeping up my spine.

The man pushed back his hood, revealing a face I recognized from the tavern earlier. He had been one of the patrons, a quiet man who had sat alone in the corner, nursing a single drink all night. His eyes were piercing, almost unnaturally bright in the dimness of the alley.

"My name is not important," he said, his gaze locked on mine. "What's important is what I have to offer you."

I scoffed, my grip tightening on my dagger. "And what, pray tell, is that?"

The man took a step closer, his eyes glinting in the faint light. "Adventure," he said, his voice barely above a whisper. "Excitement. A chance to make a name for yourself in a world that has forgotten the power of music."

I hesitated, my heart pounding in my chest. This could be a trap, a ruse to lure me into danger. And yet, there was something in the man's eyes that made me want to believe him, made me want to take the risk.

"I'm listening," I said finally, lowering my dagger but not sheathing it.

The man smiled, a thin, secretive smile that sent a shiver down my spine. "Good," he said, his voice low. "Because the world needs a hero, Elara. And that hero is you."

As he spoke, a strange feeling washed over me, a sense of purpose and destiny that I had never felt before. In that moment, I knew that my life was about to change, that I was on the cusp of something greater than I could have ever imagined.

And so, with a deep breath, I took a step forward into the unknown, ready to embrace whatever adventures lay ahead. Little did I know, the path before me was fraught with danger, betrayal, and heartache. But it was also a path to greatness, to a destiny that would forever change the course of history. And as I walked beside the mysterious man, the darkness of the night giving way to the first light of dawn, I knew that I was ready to face whatever came my way.

For I was Elara, the elf bard, and I was destined for greatness.