Quantized with these options:
python convert.py
-i /workspace/text-generation-webui/models/meta-llama_Llama-3.3-70B-Instruct
-o /workspace/temp/
-m /workspace/measurement.json
-l 16000
-cf /workspace/2.25
-b 2.25
-c /workspace/converted_rp.parquet
-r 100
Dataset is long context synthetic roleplay multiturn dataset pre formatted with llama instruct role added between each turn.
https://huggingface.co/datasets/openerotica/multi-turn-aware-quantization-llama-3.3-rp-test