Pi3141
/

alpaca-7b-native-enhanced-GPTQ-safetensors

Text Generation

4-bit precision

Model card Files Files and versions Community

Pi3141 commited on Dec 3, 2023

Commit

11e94ef

•

1 Parent(s): 83b941f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ Non-safetensor version: [pi3141/alpaca-7b-native-enhanced-GPTQ](https://huggingf
 ### Loading model in Oobabooga WebUI
 - Use same parameters as the original model, which can be found in the original repo linked below.
-- Use `AutoGPTQ` loader.
 ### Information about original model
 *Original repo: [8bit-coder/alpaca-7b-nativeEnhanced](https://huggingface.co/8bit-coder/alpaca-7b-nativeEnhanced)*

 ### Loading model in Oobabooga WebUI
 - Use same parameters as the original model, which can be found in the original repo linked below.
+- Use `ExLlamav2` loader.
 ### Information about original model
 *Original repo: [8bit-coder/alpaca-7b-nativeEnhanced](https://huggingface.co/8bit-coder/alpaca-7b-nativeEnhanced)*