Hugging Face's logo
hanswang73's picture
16

hanswang73

hanswang73

AI & ML interests

None yet

Organizations

None yet

hanswang73's activity

New activity in 01-ai/Yi-34B-Chat-4bits 11 months ago

这个一般推荐什么推理框架（来做stream）？

2
#2 opened 12 months ago by hanswang73
New activity in deepseek-ai/deepseek-llm-67b-chat 12 months ago

Can you provide 4-bits version ?

1
#7 opened 12 months ago by hanswang73
New activity in TheBloke/Yi-34B-Chat-AWQ 12 months ago

what is the difference between this model and https://huggingface.co/01-ai/Yi-34B-Chat-4bits ?

2
#1 opened 12 months ago by hanswang73
New activity in BAAI/AquilaChat2-34B-16K about 1 year ago

这个会出4bits量化版本吗？

2
#1 opened about 1 year ago by hanswang73
New activity in BAAI/AquilaChat2-34B about 1 year ago

4Bits量化版本马上就出来了吧？

3
#1 opened about 1 year ago by hanswang73
New activity in BAAI/llm-embedder about 1 year ago

这个模型是干嘛用的？

2
#1 opened about 1 year ago by hanswang73
New activity in baichuan-inc/Baichuan2-13B-Chat-4bits about 1 year ago

有测试过，2-13b-chat，4bits量化后，各种评分损失有多少吗？
#3 opened about 1 year ago by hanswang73
New activity in BAAI/bge-reranker-large about 1 year ago

2个问题

10
#2 opened about 1 year ago by hanswang73
New activity in baichuan-inc/Baichuan-13B-Chat over 1 year ago

关于量化8bits的推理速度
#31 opened over 1 year ago by hanswang73

重复问题
#30 opened over 1 year ago by hanswang73

英文推理报错

19
#26 opened over 1 year ago by hanswang73
New activity in mosaicml/mpt-30b-chat over 1 year ago

Why inference is very slow?
#17 opened over 1 year ago by hanswang73
New activity in intfloat/multilingual-e5-large over 1 year ago

Does it support chinese?

5
#6 opened over 1 year ago by hanswang73
New activity in THUDM/chatglm-6b over 1 year ago

v1.1，加载时报错 Unable to load weights from pytorch checkpoint file for '...'. If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

3
#72 opened over 1 year ago by hanswang73