This are the quantizations of the model LightOnOCR-1B-1025
Original model: https://huggingface.co/lightonai/LightOnOCR-1B-1025
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results. F32 > BF16 > F16
- Downloads last month
- 671
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit
6-bit
8-bit
16-bit
32-bit
Model tree for noctrex/LightOnOCR-1B-1025-GGUF
Base model
lightonai/LightOnOCR-1B-1025