Update max_position_embeddings to 128k context size instead of 32k

by qwopqwop - opened Oct 11

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

-1

qwopqwop

Oct 11

•

edited Oct 11

Update max_position_embeddings to 128k context size instead of 32k
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407/commit/5c9ce5b5f7a7ad62d03e8c66c719b66d586de26b

Update max_position_embeddings to 128k context size instead of 32k(https://huggingface.co/mistralai/Mistral-Large-Instruct-2407/commit/5c9ce5b5f7a7ad62d03e8c66c719b66d586de26b)aaf19738

qwopqwop changed pull request title from Update max_position_embeddings to 128k context size instead of 32k(https://huggingface.co/mistralai/Mistral-Large-Instruct-2407/commit/5c9ce5b5f7a7ad62d03e8c66c719b66d586de26b) to Update max_position_embeddings to 128k context size instead of 32k Oct 11

TechxGenus changed pull request status to merged Oct 11

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment