unusable
#4
by
Skorcht
- opened
talks as user with your config exlama 4bpw
Try enabling wrap sequences with newline. Plenty of people are running the model without issue, and i run it myself daily since launch with the 4bpw exl2 i provided.
Nitral-AI
changed discussion status to
closed