fenjun's picture

13 6

fenjun

dafen

·

AI & ML interests

None yet

Organizations

None yet

dafen's activity

New activity in alexwww94/glm-4v-9b-gptq-4bit 3 months ago

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#1 opened 3 months ago by

Very time-consuming, GLM-4v-9B only takes 5 seconds to process, GLM-4v-9B-gptq-4bit takes 90 seconds

#2 opened 3 months ago by

New activity in zphilip48/nougat-middle-cn 3 months ago

可以帮忙提供一下使用代码吗

#1 opened 3 months ago by

New activity in internlm/internlm2-chat-20b 10 months ago

prompt好像还有些问题

#6 opened 10 months ago by

请求适配vllm框架

#2 opened 10 months ago by

New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ 10 months ago

always getting 0 in output

#3 opened 11 months ago by

New activity in yuyijiong/Qwen-14b-chat-yarn-32k 10 months ago

能否上传到modelscope上，感谢

#6 opened 10 months ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K about 1 year ago

我尝试采用你们官方的vllm推理，发现和hf推理的结果相差非常大

#3 opened about 1 year ago by

New activity in vivo-ai/BlueLM-7B-Base-32K about 1 year ago

指定GPU后会报错CUBLAS_STATUS_EXECUTION_FAILED

#1 opened about 1 year ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K about 1 year ago

failed when loading model

#2 opened about 1 year ago by

New activity in TheBloke/KAI-7B-Instruct-GPTQ about 1 year ago

Can you please help me quantize vivo-ai/BlueLM-7B-Chat to int8?

#1 opened about 1 year ago by

New activity in baichuan-inc/Baichuan2-13B-Chat about 1 year ago

OSError: We couldn't connect to 'https://huggingface.co' to load this file,

#7 opened about 1 year ago by

OSError: We couldn't connect to 'https://huggingface.co' to load this file,

#7 opened about 1 year ago by