Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,8 @@ language:
|
|
| 11 |
# TinyLlama-1.1B
|
| 12 |
</div>
|
| 13 |
|
|
|
|
|
|
|
| 14 |
The TinyLlama project aims to **pretrain** a **1.1B Llama model on 3 trillion tokens**. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.
|
| 15 |
|
| 16 |
<div align="center">
|
|
|
|
| 11 |
# TinyLlama-1.1B
|
| 12 |
</div>
|
| 13 |
|
| 14 |
+
https://github.com/jzhang38/TinyLlama
|
| 15 |
+
|
| 16 |
The TinyLlama project aims to **pretrain** a **1.1B Llama model on 3 trillion tokens**. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.
|
| 17 |
|
| 18 |
<div align="center">
|