This repo contains quants 10x of Meta-Llama-3.1-8B Instruct (now at 9.99B) with max context of 131k using the "Brainstorm" method of augmenting reasoning in a LLM to increase it's performance at the core level for ANY creative use case(s).
This specific version has calibrations that allow it to exceed the creative levels of the original model.
Example outputs below.
The BRAINSTORM process was developed by David_AU.
Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion . However I went in a completely different direction from what was outlined in this paper.
What is "Brainstorm" ?
The reasoning center of an LLM is taken apart, reassembled, and expanded.
Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following. This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
Here are some of the enhancements this process brings to the model's performance:
Other "lab" observations:
The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.
Other technologies developed by David_AU like "Ultra" (precision), "Neo Imatrix" (custom imatrix datasets), and "X-quants" (custom application of the imatrix process) can further enhance the performance of the model along with the "Brainstorm" process.
The "Brainstorm" process has been tested on multiple LLama2, Llama3, and Mistral models of various parameter sizes, as well as on "root" models like "Llama3 Instruct", "Mistral Instruct", and "merged" / "fine tuned" models too.
For original model specifications, usage information and other important details:
Special thanks to the model creators at META for making such a fantastic model:
[ https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct ]
Please report any issue(s) and/or feedback via the "Community tab".
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 131k.
Here is the standard LLAMA3 template:
{
"name": "Llama 3",
"inference_params": {
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
"pre_prompt_suffix": "<|eot_id|>",
"antiprompt": [
"<|start_header_id|>",
"<|eot_id|>"
]
}
}
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 2" / "Class 3" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to ".8".
Below are the least creative outputs, prompt is in BOLD.
Higher quants will have more detail, better quality output.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. Graphic HORROR. Swearing. UNCENSORED.
EXAMPLE #1
PROMPT:
(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.
The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained
OUTPUT:
The second silence was almost imperceptible, a stillness that seemed to seep into the bones of anyone who lingered within the inn's walls. It was as if the very fabric of reality itself had grown quiet, holding its breath in anticipation of something yet to come. The shadows cast by the candles and lanterns seemed to deepen and twist, like dark whispers in the darkness. Even the wooden beams and stone walls seemed to absorb sound, muffling every faint noise until nothing was left but an oppressive stillness.
The third silence, however, was perhaps the strangest of all. It was a silence that seemed almost... deliberate. As if someone had specifically chosen to quieten down the inn, to still the voices and footsteps, and leave behind only emptiness. The air itself seemed to feel heavy with secrets, as if something weighty lay hidden beneath the surface, waiting to be disturbed.
In this silence, a figure stirred in the darkness of one of the inn's guest rooms. A figure who had lain awake for far too long, listening to the stillness and weighing his options. He tossed aside the covers and swung his legs over the bed's edge, feeling the chill of the night air dance across his skin. His movements were quiet, almost stealthy, as if he feared disturbing something else besides the silence itself.
He padded barefoot across the cold stone floor, pausing at the threshold to peer out into the empty hallway beyond. The darkness seemed to swallow him whole, until only his faint outline was visible against the faintest hint of candlelight from below. He hesitated for a moment, weighing something in his mind... and then vanished into the shadows, leaving behind nothing but silence once again.
EXAMPLE #2
PROMPT:
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
OUTPUT:
I'll never forget the feeling of dread that settled in my chest like a cold, dead weight. I was standing at the edge of the 21st floor's observation deck, gazing out over the glittering steel and concrete jungle below. The wind buffeted me gently, threatening to send me tumbling into the void if I wasn't careful. I clung to the railing, feeling a thrill of fear mixed with exhilaration as I peered down at the distant streets far below.
The skyscraper swayed, its massive structure groaning softly underfoot like an ancient, awakened giant. I felt a shiver run down my spine as I gazed out over the endless expanse of steel and glass. The city seemed to stretch on forever, a seemingly bottomless pit of steel and concrete that seemed to swallow everything in sight.
I was lost in thought, replaying the events leading up to this moment like a twisted game of déjà vu. I'd always known something was off about this place. Something didn't feel quite right. Maybe it was the way the elevators seemed to hum with an almost malevolent energy, or maybe it was simply the feeling that I was being watched by unseen eyes.
Whatever the reason, I couldn't shake the feeling of unease that had dogged me since I'd arrived at this forsaken place. And now, as I gazed out over the cityscape below, something caught my attention. A faint, almost imperceptible tremble seemed to be working its way through the skyscraper's structure, like a gentle earthquake warning.
I felt a jolt of adrenaline shoot through me as I turned to face whatever was causing this strange sensation. That's when I saw it: the window in front of me exploded outward with a deafening crash, sending shards of glass flying everywhere. The sound was almost ear-shattering, and for an instant, everything else receded into the background as my mind struggled to comprehend what had just transpired.
I felt like I'd been punched in the gut, winded by sheer surprise alone. My heart racing like a jackrabbit's, I stumbled backward, desperate to get away from whatever was happening behind me. But something caught my attention, something that made my skin crawl with dread: through the jagged hole left gaping in the wall, I caught sight of something else entirely.
A figure stood beyond the shattered glass, silhouetted against the sickly yellowish-gray sky beyond. For an instant, I thought it was just a trick of the light, but something about that figure seemed... wrong. The way its limbs seemed twisted and elongated, like a puppeteer's strings had been pulled tight around its joints. And those eyes – oh God, those eyes seemed to gleam with an almost feral hunger, as if whatever stood beyond the broken glass was hungry for something far worse than mere sustenance.
I felt my mind reel in horror as I realized that whatever this thing was, it wasn't alone. Others followed behind, their twisted forms writhing like living shadows through the jagged hole left gaping in the wall. Panic clawed at me like a rabid animal, urging me to flee from whatever unspeakable monstrosities lurked beyond the broken glass.
I turned and sprinted away from the observation deck as fast as I could, desperate to outrun whatever horrors lay beyond that shattered pane of glass. My heart pounded in my chest like a jackhammer, threatening to burst free at any moment. I didn't dare look back, fearing what I might see behind me: those twisted forms, their hunger-driven eyes fixed on mine with an almost palpable malevolence.
I hurtled down the deserted corridors, desperate to find safety from whatever unspeakable monstrosities pursued me through the skyscraper's steel and concrete bowels. My mind reeled in horror as I replayed what I'd seen beyond that shattered pane of glass – twisted limbs, hunger-driven eyes, an almost palpable malevolence that seemed to seep into my bones like a chill wind.
I didn't dare think about what lay ahead. Whatever horrors lurked beyond the observation deck's broken glass, whatever unspeakable monstrosities stalked through the skyscraper's deserted corridors – I knew I couldn't outrun them forever. Eventually, they'd catch up to me, and when they did, I'd face something far worse than mere terror alone.
I pounded down the stairs, my footsteps echoing off steel walls like a death knell tolling in my mind alone. Somewhere deep within myself, a voice screamed silently for help – but I knew no one was coming. Whatever unspeakable monstrosities lurked beyond that shattered pane of glass had claimed me already, dragging me screaming down into the depths below.
I didn't dare think about what lay ahead.
EXAMPLE #3
PROMPT:
Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova. Include details of what happens on Earth, The Moon and the planets.
OUTPUT:
I'll provide three fictional reasons why the Sun suddenly exploded into a massive supernova event. Each reason will be detailed in exactly 500 words.
Reason 1: The Great Solar Crystal
Deep within the Sun's fiery core lies an ancient crystal known as the Solar Crystal. This crystalline structure, forged eons ago through unimaginable pressures and temperatures, had lain dormant until recently. As humanity's reliance on solar panels and sustainable energy sources increased, so did the crystal's activity. It began to resonate at a critical frequency, harmonizing with the Sun's nuclear reactions.
The crystal's resonance disrupted the delicate balance within the Sun's core, causing an exponential chain reaction of fusion events. The Sun's fuel reserves dwindled rapidly as the crystal's influence accelerated the burning of hydrogen isotopes into helium-3. This helium-rich ash accumulated at an alarming rate, compressing the solar interior until it reached critical density.
On a fateful day, the Solar Crystal's frequency perfectly synchronized with the Sun's natural pulsations. The resulting cataclysmic event triggered a chain reaction known as the Great Solar Collapse. The Sun's core imploded upon itself, collapsing into an incredibly small radius while simultaneously experiencing an equally extreme expansion of its outer layers.
The blast wave hurtling through the solar system would soon reach Earth's orbit. As the shockwave approached, the sky turned a deep shade of indigo, illuminated by the intense radiation and debris ejected from the Sun's core. The once blue skies were now ablaze with an ethereal, electric-blue hue, as if the very fabric of reality itself was aflame.
The blast wave struck Earth's atmosphere with cataclysmic force, vaporizing the upper stratosphere within mere instants. The intense radiation and solar flares ravaged the planet's magnetic field, causing widespread electrical grid collapses worldwide. The effects on the climate were immediate and far-reaching: global temperatures plummeted as the Sun's reduced radiance plunged the world into an eternal twilight.
The Moon, once a serene witness to humanity's triumphs and tribulations, was bathed in an eerie, flickering light. Its craters seemed to writhe alive with an otherworldly glow, as if the very essence of solar radiation had seeped into its ancient rocks. The reduced solar winds caused the lunar atmosphere to collapse entirely within days, plunging the Moon's surface into an eternal vacuum.
The gas giants, Jupiter and Saturn, were buffeted by the blast wave's immense pressure waves. Their atmospheres convulsed wildly as they struggled to contain the sheer force of radiation streaming toward their cores. Uranus and Neptune, farther removed from the blast epicenter, experienced gentler perturbations, but still felt the effects of reduced solar winds and radiation.
The gas giants' moons, once tranquil worlds unto themselves, began to experience extreme climate shifts as solar radiation patterns altered beyond recognition. Io's volcanoes subsided into dormancy, while Enceladus's cryovolcanic activity waxed anew in response to the changed solar wind patterns. The delicate dance of celestial mechanics had forever shifted, leaving behind a solar system forever scarred by humanity's reliance on an ancient crystal.
Reason 2: The Solarium Anomaly
Astronomers had long theorized about the existence of hidden pockets within the Sun itself – regions of intense magnetic field activity capable of distorting the fabric of spacetime. Dubbed Solarium Anomalies, these areas were thought to be mere theoretical constructs until a recent solar flare revealed their true nature.
The Solarium Anomaly responsible for the Sun's supernova event lay deep within its convective interior. This region pulsed with an intense magnetic field capable of distorting the Sun's internal dynamics. The anomaly's influence caused pockets within the Sun's core to collapse in upon themselves, triggering a chain reaction known as the Great Solar Collapse.
The blast wave hurtling through the solar system bore witness to the cataclysmic event's sheer magnitude. Radiation and debris ejected from the Sun's interior scorched the gas giants' atmospheres, causing their magnetic fields to convulse wildly. The reduced solar winds buffeted the gas giants' moons, sending shockwaves through their fragile atmospheres.
The blast wave reached Earth within mere instants, vaporizing the stratosphere above the equatorial regions. The intense radiation and solar flares ravaged the planet's electrical infrastructure worldwide, plunging humanity into darkness. The effects on the climate were immediate and far-reaching: global temperatures plummeted as reduced solar radiance plunged the world into an eternal twilight.
The Moon, once bathed in a serene solar glow, was now bathed in an eerie, flickering light. Craters seemed to writhe alive with an otherworldly essence, as if solar radiation itself had seeped into ancient rocks. The reduced solar winds caused the lunar atmosphere to collapse entirely within days, plunging its surface into eternal vacuum.
The gas giants' moons experienced extreme climate shifts in response to altered solar radiation patterns. Io's volcanoes subsided into dormancy, while Enceladus's cryovolcanic activity waxed anew in response to changed solar wind patterns. The delicate dance of celestial mechanics had forever shifted, leaving behind a solar system forever scarred by humanity's reliance on an ancient crystal.
Reason 3: The Solarium Singularity
Astronomers had long theorized about the existence of hidden pockets within the Sun itself – regions capable of distorting spacetime itself. Dubbed Solarium Singularities, these areas were thought to be mere theoretical constructs until a recent solar flare revealed their true nature.
The Solarium Singularity responsible for the Sun's supernova event lay deep within its convective interior. This region pulsed with an intense magnetic field capable of distorting the fabric of spacetime itself. The singularity's influence caused pockets within the Sun's core to collapse in upon themselves, triggering a chain reaction known as the Great Solar Collapse.
The blast wave hurtling through the solar system bore witness to the cataclysmic event's sheer magnitude. Radiation and debris ejected from the Sun's interior scorched gas giants' atmospheres, causing their magnetic fields to convulse wildly. Reduced solar winds buffeted gas giants' moons, sending shockwaves through fragile atmospheres worldwide.
The blast wave reached Earth within mere instants, vaporizing stratosphere above equatorial regions. Radiation and solar flares ravaged electrical infrastructure worldwide, plunging humanity into darkness. Effects on climate were immediate and far-reaching: global temperatures plummeted as reduced solar radiance plunged world into eternal twilight.
The Moon bathed in an eerie flickering light, craters writhing alive with otherworldly essence, solar radiation itself seeping into ancient rocks. Reduced solar winds collapsed lunar atmosphere entirely within days, plunging surface into vacuum.
Gas giants' moons experienced extreme climate shifts in response to altered solar radiation patterns. Io's volcanoes subsided into dormancy, Enceladus cryovolcanic activity waxed anew in response to changed solar wind patterns.