BenevolenceMessiah
commited on
Commit
•
892c08d
1
Parent(s):
afe43be
Update README.md
Browse files
README.md
CHANGED
@@ -154,6 +154,36 @@ model-index:
|
|
154 |
url: https://www.placeholderurl.com
|
155 |
name: Open LLM Leaderboard
|
156 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
157 |
# Replete-Coder-llama3-8b
|
158 |
Finetuned by: Rombodawg
|
159 |
### More than just a coding model!
|
|
|
154 |
url: https://www.placeholderurl.com
|
155 |
name: Open LLM Leaderboard
|
156 |
---
|
157 |
+
Greetings friends, Asalamu Alaikum; I am pleased to provide you with GGUF vresions of this great model!
|
158 |
+
<!-- description start -->
|
159 |
+
## Description (per TheBloke)
|
160 |
+
|
161 |
+
This repo contains GGUF format model files.
|
162 |
+
|
163 |
+
These files were quantised using ggml-org/gguf-my-repo [https://huggingface.co/spaces/ggml-org/gguf-my-repo]
|
164 |
+
|
165 |
+
<!-- description end -->
|
166 |
+
<!-- README_GGUF.md-about-gguf start -->
|
167 |
+
### About GGUF (per TheBloke)
|
168 |
+
|
169 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
170 |
+
|
171 |
+
Here is an incomplete list of clients and libraries that are known to support GGUF:
|
172 |
+
|
173 |
+
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
174 |
+
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
175 |
+
* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
|
176 |
+
* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
|
177 |
+
* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
|
178 |
+
* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
|
179 |
+
* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
|
180 |
+
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
|
181 |
+
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
182 |
+
* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
|
183 |
+
|
184 |
+
<!-- README_GGUF.md-about-gguf end -->
|
185 |
+
<!-- repositories-available start -->
|
186 |
+
---
|
187 |
# Replete-Coder-llama3-8b
|
188 |
Finetuned by: Rombodawg
|
189 |
### More than just a coding model!
|