homebrewltd
/

llama3-s-init

Text Generation

sound language model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jan-hq commited on Jul 22

Commit

a247504

•

1 Parent(s): d9879f9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ We have developed and released the family [Jan-Llama3-Sound](https://huggingface
 We continue to expand [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) with sound understanding capabilities.
-This is the initial checkpoint with only the average weight init for new vocabulary.
 **Model developers** Homebrew Research.

 We continue to expand [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) with sound understanding capabilities.
+This is the initial checkpoint with average weight initialization applied only to new vocabulary.
 **Model developers** Homebrew Research.