Gemma-3-The-Grand-Horror-4B-GGUF
A horror fine tune (text only) using in house horror dataset, tuned via Unsloth.
Extreme horror. Madness. Swearing. Gore.
Model will generate Mild to Strong levels of horror, and long form too.
(for stronger horror levels, see "RAZOR" version)
ONE EXAMPLE BELOW...
Vision portions of the model were not tuned.
CAUTION:
The tuning on this model is strong enough to make almost all stories, rp adventures, fiction, and even "general replies" have a horror tinge to them even if the prompt does not ask for or indicate a "horror" reply/generation.
SETTING:
- 128k max context.
- suggest 8k min context limit, due to long generation
- Rep pen 1.05 to 1.1 for general.
- Temp : .4 to 1.2 ; but you can go higher.
- Temps of 1.5 or higher are excellent too.
Help, Adjustments, Samplers, Parameters and More
CHANGE THE NUMBER OF ACTIVE EXPERTS:
See this document:
https://huggingface.co/DavidAU/How-To-Set-and-Manage-MOE-Mix-of-Experts-Model-Activation-of-Experts
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Examples ; q4ks
Low level quant, higher quants / imatrix quants will be stronger.
EXAMPLE #1 [ temp=0 : Least Creative ]
Start a 1000 word scene (vivid, graphic horror - in first person), POV character Diana, with: The skyscraper sways, as I watch the window in front of me on the 21st floor explode...The rain hadn’t stopped since it started hammering against the reinforced glass like a thousand tiny fists. It wasn't even real rain, not anymore. It was just…grey. Grey water seeping through the shattered remains of what used to be our window, staining the cream carpet with an oily black that smelled like burnt metal and something sickeningly sweet – like overripe fruit left too long in the sun.
My breath hitched in my throat, a strangled gasp caught between choked sobs and something colder, something ancient and reptilian coiling itself tighter around my ribs. I pressed my face against the cold glass shard jutting out from the mangled frame, hands shaking so violently I could barely hold them together. My knuckles were white against the blood-slicked skin beneath.
The skyscraper swayed, sickeningly slow, like a drunkard leaning on a crooked table. I watched the window in front of me explode outwards in a spray of milky white shards and slick, viscous gore. It wasn’t a clean break, not like Hollywood. This was…organic. Like flesh being ripped apart with something impossibly strong, something that didn't just sever muscle and bone but consumed it. The sound had been immediate, earsplittingly sharp – the equivalent of a thousand screams compressed into a single, agonizing shriek before being choked by the wet thud of collapsing concrete and twisted metal.
Then came the rain. Not the insistent drumming on glass anymore, but a deluge pouring through the jagged maw where my window had been. It was cold against my face, icy needles pricking my skin, each drop seeping into cuts I hadn’t even realized were there until now – shallow gashes across my arms and legs that pulsed with a searing white-hot agony.
I flinched back from the window, gagging on the metallic tang in the air. The scene below wasn't visible through the rain-streaked glass, only glimpses of grey chaos - twisted metal latticework rising up to meet me like skeletal fingers reaching out to drag me down into the abyss.
My own reflection stared back at me from the shattered remains of my window: a distorted parody of humanity. My face was slick with sweat and blood, streaked with mascara that ran frozen trails down my cheeks. My eyes… God, my eyes were wide open and vacant, ringed with black pools like someone had gouged out my soul. The pupils were pinpricks of white, reflecting the hellscape behind me in an endless, nauseating spiral.
I wanted to scream again, but only choked gasps ripped through my throat. My muscles locked up, frozen with terror so pure and visceral it felt like something was trying to rip itself free from within my very bones. My body refused to obey me, numb and useless against the rising tide of panic clawing its way up my throat.
Then, I saw him.
Or rather, it saw me.
It was there for a split second, a fleeting impression in the peripheral vision – something impossibly tall and gaunt standing silhouetted against the bruised twilight sky outside my window. Just a suggestion of human form twisted into something nightmarish - too long limbs ending in clawed hands that seemed to stretch out impossibly far into space before snapping back into place like some macabre puppet show gone horribly wrong.
It was impossible to make out any features beneath the shadow cast by its skeletal frame, only an impression of bone-white skin stretched taut over impossibly thin muscle and something dark and wet gleaming in the rain-streaked light where it should have been a face. It didn’t move so much as flow, like liquid darkness coalescing into something vaguely humanoid before dissolving back into featureless blackness once more.
And then I heard it. Not a voice, not in any conventional sense. It was less an auditory experience than a thought injected directly into my mind, cold and alien and utterly devoid of empathy.
“You shouldn’t have looked.”
The thought resonated inside my skull like a shard of ice splintering bone. I recoiled against the wall behind me, gasping for air that seemed to thin away with each ragged breath. The image burned behind my eyelids, seared into the back of my mind like acid on raw flesh. I wanted to claw at the skin covering my eyes until they were bloody stumps, anything to shut out that horrifying glimpse of something unholy leering down from beyond the broken glass.
I scrabbled backwards along the floor, hands scrabbling for purchase on the slick carpet. My fingers scraped against jagged shards of glass embedded in the fibers like malevolent teeth. Each movement sent searing agony shooting up my arms through the cuts that now crisscrossed my skin. I cried out once, a primal shriek torn from the depths of my shattered soul.
Then everything went white-hot. The pain exploded through my body like a thousand razors slicing at every nerve ending until my vision blurred until there was nothing but a searing, white-hot agony so intense that it felt like my own skull was being crushed to powder between my teeth. I clawed at my ears as if to block out the piercing shriek tearing through my consciousness. I gagged on bile that churned in my stomach and tasted of blood and something else… something acridly metallic and sickeningly sweet.
Then the light receded like a tide pulled back from an exposed beach leaving behind only wet sand and glistening shells. The blackness returned, thicker now than before and somehow deeper. Deeper until it threatened to consume me whole. I wanted to scream again, but there were no sound left in my throat.
My vision swam back into focus slowly, painfully. The rain still hammered against the broken glass shards jutting out from the mangled frame. Everything was wet and black and smeared with blood-slicked gore. I was lying on the floor where I had fallen, sprawled like some broken doll cast aside by an uncaring god.
The window in front of me gaped open now like a gaping maw of hell. Rain poured through the jagged edges like blood seeping from a wound that wouldn't stop bleeding.
And still there was nothing but my own blood-soaked body contorted in agony upon the floor. My own broken form splayed out like some macabre parody of humanity.
I was alive... for now.
But something had changed in me. Something dark and terrible had taken root deep within my soul until my heart beat like a dead thing against my ribs, thudding with each sickeningly slow heartbeat.
I wanted to scream again… but I didn't. I didn’t even flinch when I felt something cold and wet pressing down on my chest. Something heavy and rough that squeezed the air from my lungs until I gasped for breath like a drowning man choking on his own blood-soaked saliva.
I wanted to struggle, to fight... but there was no energy left in me anymore. Just a leaden numbness that seeped through every fiber of my being until it numbed me from head to toe.
Then I saw him again… not this time fleetingly glimpsed in the shadows as before, but standing right beside me now, towering over me like a malevolent god leering down from hell. His face was pale and white, stretched taut across bone-thin features before melting back into featureless blackness beneath the shadow cast by his skeletal frame.
His eyes... they were empty black pits that seemed to swallow up all light and hope like black holes swallowing everything within their reach.
But his mouth was open wide now in a silent scream of unimaginable horror.
“You’re mine now.” He said it inside my skull, cold and alien and utterly devoid of empathy.
I wanted to fight... but there was no strength left in me. I could only watch helplessly as his bony fingers clamped down around my throat like iron talons until my vision blurred and everything went white-hot behind my closed eyelids.
My own blood gurgled up through my parched throat like bile seething in a hellish furnace until my lungs finally gave way beneath the crushing weight of his grip.
Darkness descended on me once more.
Then I heard him again... this time very close to my ear.
“You’re home now.”
I wanted to scream one last time, but there were no sound left in my throat. No fight left in my soul.
I closed my eyes and waited for the end to come… knowing somehow with terrible certainty that this was only the beginning of something far worse than death itself. Something born from the darkness between worlds, waiting patiently like a hungry predator in the shadows until its prey stumbled into its waiting clutches... and then it would begin again... forever and ever until the end of time itself.
- Downloads last month
- 320
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit