Quantized Nanbeige4.1-3B
Collection
Verified models. Compatible with vLLM v0.15.1. • 5 items • Updated
This is Nanbeige/Nanbeige4.1-3B quantized with AutoRound to W4A16 (INT). The model is compatible with vLLM (tested: v0.15.1). Tested with an L4 (Google Colab).
- Developed by: The Kaitchup
- Downloads last month
- 7,233
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support