ubergarm
/

Kimi-K2-Thinking-GGUF

Text Generation

Model card Files Files and versions

Resources

View closed (1)

moonshotai/Kimi-K2.5

#16 opened about 1 month ago by

smol-IQ2_KS also passes the official K2 Vendor Verifier test!

#15 opened 3 months ago by

smol_iq3_ks

#14 opened 4 months ago by

Q4_X perplexity?

#13 opened 4 months ago by

Quant in the 320GiB and 360GiB range?

#11 opened 4 months ago by

Output not respecting lines breaks?

#10 opened 4 months ago by

the faster the inference speed becomes. Why is that?

#9 opened 4 months ago by

Testing smol-IQ4_KSS

#8 opened 4 months ago by

IQ4_KSS

#7 opened 4 months ago by

Imatrix from BF16 ?

#6 opened 4 months ago by

Benchmarks (Q8_0-Q4_0, RTX 5090, EPYC)

#5 opened 4 months ago by

IQ3_K Discussion.

#4 opened 4 months ago by

IQ2_KS

#3 opened 4 months ago by

Q4_0=INT4?

#2 opened 4 months ago by

Definitely interested in this one!

#1 opened 4 months ago by