9 5 14

wenhua cheng

wenhuach

wenhuach21

AI & ML interests

Model Compression, CV

Recent Activity

replied to their post 3 days ago

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

replied to their post 3 days ago

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

reacted to their post with 🔥 4 days ago

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

View all activity

Organizations

Posts 5

Post

1740

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

Post

326

This week, OPEA Space released several new INT4 models, including:
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
allenai/OLMo-2-1124-13B-Instruct
THUDM/glm-4v-9b
AIDC-AI/Marco-o1
and several others.
Let us know which models you'd like prioritized for quantization, and we'll do our best to make it happen!

https://huggingface.co/OPEA

View all posts

Papers 2

arxiv:2310.10944

arxiv:2309.05516

models

None public yet

datasets

None public yet