sophosympatheia
commited on
Commit
•
f37d8cb
1
Parent(s):
ac6a658
Update README.md
Browse filesSo begins fixing the typos...
README.md
CHANGED
@@ -19,7 +19,7 @@ license: other
|
|
19 |
### Overview
|
20 |
|
21 |
This model is a multi-level SLERP merge of several Llama 3 70B variants. See the merge recipe below for details.
|
22 |
-
I extended
|
23 |
|
24 |
This model is uncensored. *You are responsible for whatever you do with it.*
|
25 |
|
|
|
19 |
### Overview
|
20 |
|
21 |
This model is a multi-level SLERP merge of several Llama 3 70B variants. See the merge recipe below for details.
|
22 |
+
I extended the context window for this model out to 32K by snagging some layers from [abacusai/Smaug-Llama-3-70B-Instruct-32K](https://huggingface.co/abacusai/Smaug-Llama-3-70B-Instruct-32K) using a technique similar to what I used for Midnight Miqu, which was further honed by [jukofyork](https://huggingface.co/jukofyork).
|
23 |
|
24 |
This model is uncensored. *You are responsible for whatever you do with it.*
|
25 |
|