Upload README.md

README.md

@@ -61,6 +61,18 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
 <!-- prompt-template end -->
 
 
+
+<!-- README_GPTQ.md-compatible clients start -->
+## Known compatible clients / servers
+
+These GPTQs are known to work in the following inference servers/webuis:
+
+- [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
+- [KobaldAI United](https://github.com/henk717/koboldai)
+- [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui)
+- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
+<!-- README_GPTQ.md-compatible clients end -->
+
 <!-- README_GPTQ.md-provided-files start -->
 ## Provided files, and GPTQ parameters
 
@@ -298,13 +310,11 @@ print(pipe(prompt_template)[0]['generated_text'])
 <!-- README_GPTQ.md-compatibility start -->
 ## Compatibility
 
-The files provided are tested to work with AutoGPTQ, both via Transformers and using AutoGPTQ directly.
-
-They also work with [Occ4m's GPTQ-for-LLaMa fork](https://github.com/0cc4m/KoboldAI) and in [KobaldAI](https://github.com/KoboldAI/KoboldAI-Client).
+The files provided are tested to work with Transformers. For non-Mistral models, AutoGPTQ can also be used directly.
 
 [ExLlama](https://github.com/turboderp/exllama) is compatible with Llama and Mistral models in 4-bit. Please see the Provided Files table above for per-file compatibility.
 
-[Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) is compatible with all GPTQ models.
+For a list of clients/servers, please see "Known compatible clients / servers", above.
 <!-- README_GPTQ.md-compatibility end -->
 
 <!-- footer start -->