MaziyarPanahi commited on
Commit
9d08368
1 Parent(s): c290c5a

Upload folder using huggingface_hub (#1)

Browse files

- d539723039e9047a8449a1bead984798b1e6855a24b13b63f1b84353197bb1ca (9b5d47225c4097b58166667e83b2bcef0a8f92c9)
- 59bace616b7326986b64832be06df1ddd0ed048a4311560a5510dcf800688946 (d46ca322e7b23dc6f8643bc133650a0562cb3a3f)
- 5616169f5ef6aedcdee3b691eb8e14e85cdbaec4543859d40a4331b9abb1ce49 (a5168d3ad499145f98d2c73784f36c235db858fc)
- a705ced2a0656401b5132725cf8f145adb5fa6385663d494bebf01faacb2b3f9 (ba45cb0a3908e159fafcd1f91989c4bbd80b6b29)
- bf06287b40ba849ebc27d450ba084467028dc30820beb4445b67b28ae8849518 (5015a596ec859295f512f76a9492ec7ea7eb6ba0)
- b95ea62e42be44873f1d3ed4b5f9589cdce46fcd8c8b87a1ef5e5fa33aa07491 (c8e11b7cf6f417ca97aa993f6762510f8a775f80)

.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Llama-3.1-AlternateTokenizer.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3.1-AlternateTokenizer.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3.1-AlternateTokenizer.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3.1-AlternateTokenizer.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-3.1-AlternateTokenizer.fp16.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-3.1-AlternateTokenizer-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
Llama-3.1-AlternateTokenizer-GGUF_imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec2ef8641f31585025267352bc7c23637366fc0507f80fbae1f80957b2d79aae
3
+ size 4988146
Llama-3.1-AlternateTokenizer.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c448d9f2e2afbca781ba38990d354657d46275f90bdbe9e2c090bd510abb3331
3
+ size 5732987680
Llama-3.1-AlternateTokenizer.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74e9f95bf01c6aaa3b0cc7f04ec2de4222e7a0d2a8d9f4299f07509f17ffaa07
3
+ size 5599294240
Llama-3.1-AlternateTokenizer.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29af67352b2393c59fedcbad93faf193dbc955f52a51d16883e5515526c1db1f
3
+ size 6596006688
Llama-3.1-AlternateTokenizer.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:953ea56bdbdc0f88bafe7e9b7f7e62a733ea75fb770af01a08ae097bbd2a4d50
3
+ size 8540771104
Llama-3.1-AlternateTokenizer.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bd50e77b5070200b6f021a057e377613f5c3e5507aa60f4727fedee05aab272
3
+ size 16068891200
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - text-generation
12
+ - text-generation
13
+ model_name: Llama-3.1-AlternateTokenizer-GGUF
14
+ base_model: teknium/Llama-3.1-AlternateTokenizer
15
+ inference: false
16
+ model_creator: teknium
17
+ pipeline_tag: text-generation
18
+ quantized_by: MaziyarPanahi
19
+ ---
20
+ # [MaziyarPanahi/Llama-3.1-AlternateTokenizer-GGUF](https://huggingface.co/MaziyarPanahi/Llama-3.1-AlternateTokenizer-GGUF)
21
+ - Model creator: [teknium](https://huggingface.co/teknium)
22
+ - Original model: [teknium/Llama-3.1-AlternateTokenizer](https://huggingface.co/teknium/Llama-3.1-AlternateTokenizer)
23
+
24
+ ## Description
25
+ [MaziyarPanahi/Llama-3.1-AlternateTokenizer-GGUF](https://huggingface.co/MaziyarPanahi/Llama-3.1-AlternateTokenizer-GGUF) contains GGUF format model files for [teknium/Llama-3.1-AlternateTokenizer](https://huggingface.co/teknium/Llama-3.1-AlternateTokenizer).
26
+
27
+ ### About GGUF
28
+
29
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
30
+
31
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
32
+
33
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
34
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
35
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
36
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
37
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
38
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
39
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
40
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
41
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
42
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
43
+
44
+ ## Special thanks
45
+
46
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.