Hugging Face's logo
wang weimin's picture
23

wang weimin

william0014
21world's profile picture
·

AI & ML interests

None yet

Organizations

easypay's profile picture

william0014's activity

New activity in mlabonne/Llama-3.1-70B-Instruct-lorablated 2 months ago

is there AWQ 4bit for this model?

1
#9 opened 2 months ago by william0014
New activity in Qwen/Qwen2-72B-Instruct-GPTQ-Int4 3 months ago

性能不稳定.

1
#6 opened 3 months ago by william0014
New activity in cognitivecomputations/dolphin-2.9.2-qwen2-72b 4 months ago

[AUTOMATED] Model Memory Requirements

2
#3 opened 5 months ago by model-sizer-bot
New activity in OpenGVLab/InternVL2-8B 5 months ago

lmdeploy 支持类openai api方式启动这个模型吗?

3
#2 opened 5 months ago by william0014
New activity in openbmb/MiniCPM-Llama3-V-2_5 5 months ago

OCR问题

1
#51 opened 5 months ago by william0014

CUDA out of memory (4090 24G)

2
#44 opened 5 months ago by weiminw
New activity in Qwen/Qwen2-57B-A14B-Instruct 5 months ago

部署需要多少显存?

1
#4 opened 5 months ago by william0014
New activity in 01-ai/Yi-1.5-34B-Chat-16K 6 months ago

会出量化版本吗?

2
#3 opened 6 months ago by william0014
New activity in Orenguteng/Llama-3-8B-Lexi-Uncensored 6 months ago

need Chinese support
#11 opened 6 months ago by william0014
New activity in shenzhi-wang/Llama3-70B-Chinese-Chat 6 months ago

能不能提供awq或gptq量化模型

5
#6 opened 6 months ago by bujido
New activity in THUDM/cogvlm2-llama3-chat-19B 6 months ago

是否会支持提供chat函数支持默认的chat template

1
#8 opened 6 months ago by william0014
New activity in THUDM/cogvlm2-llama3-chinese-chat-19B 6 months ago

会有量化版本吗?

1
#2 opened 6 months ago by william0014
New activity in Qwen/Qwen1.5-32B-Chat-AWQ 8 months ago

推理速度比14B-AWQ慢很多,是否正常
#1 opened 8 months ago by william0014
New activity in 01-ai/Yi-34B-200K 8 months ago

Yi-34B-200K 是否有4bit量化版?

1
#20 opened 8 months ago by william0014
New activity in abacusai/Liberated-Qwen1.5-14B 8 months ago

Need AWQ OR GPTQ int4 version
#2 opened 8 months ago by william0014
New activity in Qwen/Qwen1.5-MoE-A2.7B-Chat 8 months ago

请问这个版本GPU内存消耗28G与14B对比如何?

7
#7 opened 8 months ago by william0014
New activity in Qwen/Qwen1.5-14B-Chat 8 months ago

是否有计划释放更长的context比如200K+?
#7 opened 8 months ago by william0014
New activity in Qwen/Qwen-VL-Chat 8 months ago

VL-Chat测试中学物理试卷识别胡说八道

5
#18 opened 8 months ago by william0014

是否有计划采用Qwen2-14B?
#17 opened 8 months ago by william0014
New activity in 01-ai/Yi-34B-Chat 11 months ago

请问如何设置batch

1
#13 opened 11 months ago by william0014