RedHatAI
/

Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

alexmarques commited on Oct 10, 2024

Commit

b5b7bd4

·

verified ·

1 Parent(s): 182abc2

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -128,8 +128,6 @@ oneshot(
 model.save_pretrained("Meta-Llama-3.1-70B-Instruct-quantized.w4a16")
 ```
 ## Evaluation
 This model was evaluated on the well-known Arena-Hard, OpenLLM v1, OpenLLM v2, HumanEval, and HumanEval+ benchmarks.

 model.save_pretrained("Meta-Llama-3.1-70B-Instruct-quantized.w4a16")
 ```
 ## Evaluation
 This model was evaluated on the well-known Arena-Hard, OpenLLM v1, OpenLLM v2, HumanEval, and HumanEval+ benchmarks.