Can the model run on Apple Silicon?

#23
by tleyden - opened

Can this model be quantized and converted into GGUF (or similar) to be able to run on Apple Silicon?

Sign up or log in to comment