Available EXL3 v0.0.15 quants

Type	Size	CLI
H8-4.0BPW	7.48 GB	Copy-paste the line or Download the batch file
H8-6.0BPW	10.21 GB	Copy-paste the line or Download the batch file
H8-8.0BPW	12.94 GB	Copy-paste the line or Download the batch file

Requirements: A python installation with huggingface-hub module to use CLI.

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for DeathGodlike/Pantheon-RP-1.6-12b-Nemo-KTO_EXL3

Base model

Finetuned

Quantized

(6)

this model