add readme.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- cerebras/SlimPajama-627B
|
| 4 |
+
tags:
|
| 5 |
+
- ggml
|
| 6 |
+
---
|
| 7 |
+
# BTLM-3B GGML
|
| 8 |
+
Bittensor Language Model (BTLM-3B-8k-base) is a 3 billion parameter language model with an 8k context length trained on 627B tokens of SlimPajama.
|
| 9 |
+
|
| 10 |
+
> This is just model conversion into ggml format, model is not actaully implemented so you cannot use it. Stay tuned!
|
| 11 |
+
|
| 12 |
+
|
| 13 |
+
Ref: https://huggingface.co/cerebras/btlm-3b-8k-base
|