YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
AI & ML interests
None defined yet.
Organization Card
Chris De Sa's lab at Cornell. https://github.com/Cornell-RelaxML
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 15 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 15 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 9 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 12
YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 15 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 15 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 9 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 12
models
65
relaxml/Llama-2-7B-Hessians-2Sided
Updated
relaxml/Llama-3.1-70B-Instruct-4Bit-YAQA-QTIP
19B
β’
Updated
β’
3
relaxml/Llama-3.1-70B-Instruct-3Bit-YAQA-QTIP
15B
β’
Updated
β’
2
relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP
11B
β’
Updated
β’
3
relaxml/Llama-3.2-3B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.2-1B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.1-8B-Instruct-Hessians-2Sided
Updated
relaxml/Llama-3.1-70B-Instruct-Hessians-2Sided
Updated
relaxml/Gemma-3-12B-Instruct-QAT-Q4_0-Dequantized
12B
β’
Updated
β’
4
relaxml/Gemma-3-12B-Instruct-Hessians-2Sided
Updated
datasets
0
None public yet