The response is being truncated
#1
by
Cyrwsk
- opened
Hello, thank you for the models. However, when using them in the browser with Transformes.js, the response is being truncated.
Like:
"SELECT student_id FROM students WHERE NOT student_id IN ("
Are you perhaps not specifying max_new_tokens or max_length? Can you attach your sample code?
Thank you very much for the max_length indeed.
Cyrwsk
changed discussion status to
closed