Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,10 @@ tags:
|
|
| 8 |
- sound language model
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
## Model Details
|
| 12 |
|
| 13 |
We have developed and released the family [llama3s](https://huggingface.co/collections/homebrew-research/llama3-s-669df2139f0576abc6eb7405). This family is natively understanding audio and text input.
|
|
@@ -30,11 +34,6 @@ We continual pretrain on the expanded vocabulary [homebrewltd/llama3.1-s-whisper
|
|
| 30 |
|
| 31 |
**Out-of-scope** The use of llama3-s in any manner that violates applicable laws or regulations is strictly prohibited.
|
| 32 |
|
| 33 |
-
## Training process
|
| 34 |
-
**Training Metrics Image**: Below is a snapshot of the training loss curve visualized.
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
### Hardware
|
| 39 |
|
| 40 |
**GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.
|
|
|
|
| 8 |
- sound language model
|
| 9 |
---
|
| 10 |
|
| 11 |
+
## Caution
|
| 12 |
+
|
| 13 |
+
This is an intermediate checkpoint.
|
| 14 |
+
|
| 15 |
## Model Details
|
| 16 |
|
| 17 |
We have developed and released the family [llama3s](https://huggingface.co/collections/homebrew-research/llama3-s-669df2139f0576abc6eb7405). This family is natively understanding audio and text input.
|
|
|
|
| 34 |
|
| 35 |
**Out-of-scope** The use of llama3-s in any manner that violates applicable laws or regulations is strictly prohibited.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
### Hardware
|
| 38 |
|
| 39 |
**GPU Configuration**: Cluster of 10x NVIDIA A6000-48GB.
|