YaRN - a NousResearch Collection

NousResearch 's Collections

YaRN

Dolma

YaRN

updated Aug 15

Extension of Llama 2 to 128k context windows

YaRN: Efficient Context Window Extension of Large Language Models

Paper • 2309.00071 • Published Aug 31, 2023 • 65
NousResearch/Yarn-Mistral-7b-128k

Text Generation • Updated Nov 2, 2023 • 15.5k • 573
NousResearch/Yarn-Solar-10b-64k

Text Generation • Updated Jan 18 • 312 • 15
NousResearch/Yarn-Llama-2-70b-32k

Text Generation • Updated Nov 20, 2023 • 35 • 38
NousResearch/Yarn-Llama-2-13b-128k

Text Generation • Updated Sep 4, 2023 • 2.16k • 114
NousResearch/Yarn-Solar-10b-32k

Text Generation • Updated Jan 18 • 729 • 10
NousResearch/Yarn-Mistral-7b-64k

Text Generation • Updated Nov 2, 2023 • 6.04k • 51
NousResearch/Yarn-Llama-2-7b-128k

Text Generation • Updated Sep 4, 2023 • 3.45k • 40
NousResearch/Yarn-Llama-2-13b-64k

Text Generation • Updated Sep 4, 2023 • 1.35k • 18
NousResearch/Yarn-Llama-2-7b-64k

Text Generation • Updated Oct 7, 2023 • 3.24k • 23
emozilla/pg_books-tokenized-bos-eos-chunked-65536

Viewer • Updated Oct 7, 2023 • 79.5k • 829 • 6
emozilla/govreport-test-tokenized

Viewer • Updated Aug 9, 2023 • 973 • 110
emozilla/pg19-test-tokenized

Viewer • Updated Aug 8, 2023 • 100 • 38
emozilla/yarn-train-tokenized-16k-mistral

Viewer • Updated Oct 11, 2023 • 208k • 220 • 13
emozilla/govreport-test-tokenized-mistral

Viewer • Updated Oct 7, 2023 • 973 • 35
emozilla/proofpile-test-tokenized-mistral

Viewer • Updated Oct 7, 2023 • 46.3k • 34 • 1
emozilla/yarn-train-tokenized-32k-mistral

Viewer • Updated Oct 21, 2023 • 104k • 116 • 1