Update README.md
Browse files
README.md
CHANGED
@@ -72,6 +72,14 @@ What is your name?
|
|
72 |
My name is Samantha.
|
73 |
```
|
74 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
75 |
## OpenLLM Leaderboard Performance
|
76 |
| T | Model | Average | ARC | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K |
|
77 |
|---|----------------------------------|---------|-------|-----------|-------|------------|------------|-------|
|
|
|
72 |
My name is Samantha.
|
73 |
```
|
74 |
|
75 |
+
## ⚡ Quantized models
|
76 |
+
|
77 |
+
* **GGUF**:https://huggingface.co/TheBloke/Dr_Samantha-7B-GGUF
|
78 |
+
* **GPTQ**: https://huggingface.co/TheBloke/Dr_Samantha-7B-GPTQ
|
79 |
+
* **AWQ**: https://huggingface.co/TheBloke/Dr_Samantha-7B-AWQ
|
80 |
+
|
81 |
+
Thanks to [TheBloke](https://huggingface.co/TheBloke) for making this available!
|
82 |
+
|
83 |
## OpenLLM Leaderboard Performance
|
84 |
| T | Model | Average | ARC | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K |
|
85 |
|---|----------------------------------|---------|-------|-----------|-------|------------|------------|-------|
|