Update README.md
Browse files
README.md
CHANGED
@@ -15,8 +15,7 @@ language:
|
|
15 |
> [!IMPORTANT]
|
16 |
> this was finetuned at 16384 context length
|
17 |
|
18 |
-
This is an experiment on long
|
19 |
-
|
20 |
## Details
|
21 |
|
22 |
This model is a fine-tuned version of [Qwen/Qwen2-1.5B](https://huggingface.co/Qwen/Qwen2-1.5B) on https://github.com/stepbasin/books/tree/master/books
|
|
|
15 |
> [!IMPORTANT]
|
16 |
> this was finetuned at 16384 context length
|
17 |
|
18 |
+
This is an experiment on long context text **generation** (i.e. 6k+ tokens generated) to evaluate if/when generation breaks down, etc. As such, all the data on which this model has been fine-tuned are full-length books.
|
|
|
19 |
## Details
|
20 |
|
21 |
This model is a fine-tuned version of [Qwen/Qwen2-1.5B](https://huggingface.co/Qwen/Qwen2-1.5B) on https://github.com/stepbasin/books/tree/master/books
|