Qwen3 0.6B

AFFECTIVELY conversion of Qwen/Qwen3-0.6B to GGUF format for edge deployment.

Model Details

Usage

With llama.cpp

./llama-cli -m qwen3-0.6b-gguf.gguf -p "Your prompt here" -n 256

With Ollama

Create a Modelfile:

FROM ./qwen3-0.6b-gguf.gguf
ollama create qwen3-0.6b-gguf -f Modelfile
ollama run qwen3-0.6b-gguf

About AFFECTIVELY

AFFECTIVELY is an emotion intelligence platform that runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power the platform's real-time emotion analysis, speech recognition, and natural language capabilities.

All conversions are optimized for edge deployment within browser and mobile memory constraints.

License

Apache 2.0 (follows upstream model license)

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for affectively-ai/qwen3-0.6b-gguf

Finetuned
Qwen/Qwen3-0.6B
Finetuned
(718)
this model