vLLM

by fullstack - opened Sep 22

Sep 22

I tried this model and the coder one, this one fail in vLLM and coder 7bgives strange output

Qwen org Sep 23

Hi, take a look at this part of the modelcard

you need to use "-instruct" ones

jklj077 changed discussion status to closed Sep 23

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment