Hugging Face's logo

Kooten
/
FlatDolphinMaid-8x7B-4bpw-exl2

Text Generation
Transformers
Safetensors
mixtral
text-generation-inference
Inference Endpoints
Model card Files Community
1
New discussion

using context above 4096 - need to set compress_pos_emb above 1?

5
#1 opened 11 months ago by Samvanity