r-g2-2024/Llama-3.1-70B-Instruct-multimodal-JP-Graph-v0.1
#1749
by
testamentaddress01
- opened
testamentaddress01
changed discussion title from
Llama-3.1-70B-Instruct-multimodal
to r-g2-2024/Llama-3.1-70B-Instruct-multimodal-JP-Graph-v0.1
Is it possible that quantizing this Llama-3.1-70B-Instruct-multimodal is difficult?
Is it possible that quantizing this Llama-3.1-70B-Instruct-multimodal is difficult?
I don't think the LlavaLlamaForCausalLM archidecture is supported but let's try it anyways.
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Llama-3.1-70B-Instruct-multimoda-GGUF for quants to appear.