| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hfhfix --> | |
| <!-- ### vocab_type: --> | |
| weighted/imatrix quants of https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B | |
| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hfhfix --> | |
| <!-- ### vocab_type: --> | |
| weighted/imatrix quants of https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B | |