Inference Providers
Active filters: awq
QuantTrio/Qwen3.5-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 233k
• 24
bullpoint/Qwen3-Coder-Next-AWQ-4bit
Text Generation
• 14B • Updated • 1.16M
• 19
mratsim/MiniMax-M2.5-BF16-INT4-AWQ
Text Generation
• 39B • Updated • 47.5k
• 36
mratsim/MiniMax-M2.5-FP8-INT4-AWQ
Text Generation
• 39B • Updated • 10.3k
• 16
QuantTrio/Qwen3.5-122B-A10B-AWQ
Image-Text-to-Text
• 125B • Updated • 38.9k
• 19
Image-Text-to-Text
• 10B • Updated • 135k
• 6
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation
• Updated • 667k
• 39
cybermotaz/nemotron3-nano-nvfp4-w4a16
Text Generation
• 18B • Updated • 15.1k
• 13
QuantTrio/Qwen3.5-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 129k
• 11
TheBloke/Llama-2-70B-Chat-AWQ
Text Generation
• 69B • Updated • 2.2k
• 24
Text Generation
• 34B • Updated • 37
• 14
Qwen/Qwen1.5-72B-Chat-AWQ
Text Generation
• 72B • Updated • 503
• 26
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
• Updated • 188k
• 89
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• Updated • 103k
• 108
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation
• 15B • Updated • 1.67M
• 28
stelterlab/Mistral-Small-24B-Instruct-2501-AWQ
Text Generation
• 24B • Updated • 431k
• 27
gaunernst/gemma-3-27b-it-int4-awq
Image-Text-to-Text
• 6B • Updated • 23.1k
• 39
Text Generation
• 15B • Updated • 323k
• 60
QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ
Text Generation
• 31B • Updated • 380k
• 41
QuantTrio/Qwen3-VL-32B-Instruct-AWQ
Image-Text-to-Text
• 33B • Updated • 102k
• 12
SamCrowdwave/Qwen2.5-32B-Instruct-abliterated-AWQ
33B • Updated • 532
• 1
nullswan/GLM-4.7-PRISM-AWQ
353B • Updated • 12
• 1
QuantTrio/MiniMax-M2.5-AWQ
Text Generation
• 229B • Updated • 90.9k
• 11
zae029/Qwen2.5-32B-Instruct-abliterated-AWQ
33B • Updated • 63
• 1
tokyotech-llm/Qwen3-Swallow-32B-RL-v0.2-AWQ-INT4
Text Generation
• 33B • Updated • 1.02k
• 2
llmfan46/Q3.5-BlueStar-27B-ultra-heretic-AWQ-int4
51B • Updated • 120
• 1
Brooooooklyn/qwen3.5-9B-unsloth-mlx
Text Generation
• 4B • Updated • 696
• 1
Brooooooklyn/qwen3.5-35B-A3B-unsloth-mlx
Text Generation
• 6B • Updated • 92
• 1
casperhansen/mpt-7b-8k-chat-awq
Text Generation
• Updated • 10
• 3
casperhansen/falcon-7b-awq
Text Generation
• Updated • 9
• 1