Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- togethercomputer/RedPajama-Data-1T
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
---
|
| 7 |
+
Here are a few gguf quantization of the model [conceptofmind/Open-LLongMA-3b](https://huggingface.co/conceptofmind/Open-LLongMA-3b)
|
| 8 |
+
|
| 9 |
+
Which is
|
| 10 |
+
**Based on:** [openlm-research/open_llama_3b_v2](https://huggingface.co/openlm-research/open_llama_3b_v2)
|
| 11 |
+
|
| 12 |
+
Open LLongMA 3B is a language model trained to have 8192 tokens of context size using linear rope_scaling 0.25, Using 1.0 it will output gibberish.
|