Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

693

Full-text search

Active filters: auto-round

Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound

2B • Updated Jul 28, 2025 • 50 • 8

Intel/Qwen3-235B-A22B-Thinking-2507-int4-AutoRound

1B • Updated Jul 29, 2025 • 909 • 3

Intel/Qwen3-Coder-480B-A35B-Instruct-int4-AutoRound

2B • Updated Jul 29, 2025 • 41 • 1

dddsaty/Tri-7B-4bit-AutoRound

1B • Updated Jul 28, 2025 • 3

Intel/Qwen2.5-VL-7B-Instruct-int4-mixed-AutoRound

2B • Updated Aug 25, 2025 • 10 • 1

Intel/Qwen3-30B-A3B-Instruct-2507-int4-mixed-AutoRound

0.6B • Updated Sep 18, 2025 • 150 • 8

Intel/Qwen3-30B-A3B-Instruct-2507-int4-AutoRound

0.6B • Updated Sep 17, 2025 • 330 • 7

Intel/Qwen3-Coder-30B-A3B-Instruct-int4-AutoRound

0.6B • Updated Aug 4, 2025 • 736 • 4

Intel/Qwen3-30B-A3B-Thinking-2507-int4-AutoRound

0.6B • Updated Sep 19, 2025 • 51 • 11

Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound

2B • Updated Nov 1, 2025 • 649 • 5

Yi30/quantized_gpt_oss_20b

3B • Updated Aug 6, 2025 • 4

Intel/gpt-oss-20b-int4-AutoRound

2B • Updated Aug 7, 2025 • 3.22k • 7

Yi30/ar_goss_20b_s

21B • Updated Aug 7, 2025 • 3

Yi30/gpt_oss_20b_ar_wfp8_afp8_static

21B • Updated Aug 7, 2025 • 4

Yi30/gpt_oss_120b_ar_wfp8_afp8_static

117B • Updated Aug 7, 2025 • 3

Yi30/qwen3-32-w8afp8-ar

33B • Updated Aug 12, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Aug 10, 2025 • 2

fbaldassarri/EleutherAI_pythia-1.4b-autogptq-int4-gs64-asym

Text Generation • 1B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autogptq-int4-gs64-sym

Text Generation • 1B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autoawq-int4-gs64-asym

Text Generation • 1B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autoawq-int4-gs64-sym

Text Generation • 1B • Updated Aug 10, 2025 • 5

fbaldassarri/EleutherAI_pythia-1.4b-autoround-int8-gs64-asym

Text Generation • 0.5B • Updated Aug 10, 2025 • 2

fbaldassarri/EleutherAI_pythia-1.4b-autoround-int8-gs64-sym

Text Generation • 0.5B • Updated Aug 10, 2025 • 2

fbaldassarri/EleutherAI_pythia-1.4b-autogptq-int8-gs64-asym

Text Generation • 1B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-autogptq-int8-gs64-sym

Text Generation • 1B • Updated Aug 10, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-deduped-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Aug 11, 2025 • 3

fbaldassarri/EleutherAI_pythia-1.4b-deduped-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Aug 11, 2025 • 2

fbaldassarri/EleutherAI_pythia-1.4b-deduped-autogptq-int4-gs64-asym

Text Generation • 1B • Updated Aug 11, 2025 • 2

fbaldassarri/EleutherAI_pythia-1.4b-deduped-autogptq-int4-gs64-sym

Text Generation • 1B • Updated Aug 11, 2025 • 3