Michael Goin PRO

mgoin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a collection 2 days ago

Vision Language Models Quantization

Collection

Vision Language Models (VLMs) quantized by Neural Magic • 4 items • Updated 2 days ago

New activity in cognitivecomputations/DeepSeek-R1-AWQ 9 days ago

when i use vllm v0.7.2 to deploy r1 awq, i got empty content

13

#10 opened 9 days ago by

bupalinyu

MLA is not supported with moe_wna16 quantization. Disabling MLA.

5

#7 opened 11 days ago by

AMOSE

updated a model 9 days ago

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-FP8

Text Generation • Updated 9 days ago • 186

upvoted a paper 12 days ago

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Paper • 2502.05003 • Published 15 days ago • 41

updated 3 models 16 days ago

nm-testing/pixtral-12b-FP8-dynamic-all

Updated 16 days ago • 28

neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 16 days ago • 18.1k • 8

mgoin/pixtral-12b

Image-Text-to-Text • Updated 16 days ago • 498 • 1

published a model 16 days ago

nm-testing/Pixtral-Large-Instruct-2411-hf-FP8-dynamic

Image-Text-to-Text • Updated 16 days ago • 86

updated 3 models 16 days ago

nm-testing/Pixtral-Large-Instruct-2411-hf-FP8-dynamic

Image-Text-to-Text • Updated 16 days ago • 86

nm-testing/Pixtral-Large-Instruct-2411-hf

Image-Text-to-Text • Updated 16 days ago • 198

nm-testing/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Updated 16 days ago • 335

published a model 16 days ago

nm-testing/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Updated 16 days ago • 335

updated a model 16 days ago

nm-testing/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 16 days ago • 481

published a model 16 days ago

nm-testing/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 16 days ago • 481

updated a model 16 days ago

nm-testing/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Updated 16 days ago • 210

published a model 16 days ago

nm-testing/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Updated 16 days ago • 210

New activity in neuralmagic/gemma-2-9b-it-FP8 17 days ago

AttributeError: 'Gemma2Config' object has no attribute 'interleaved_sliding_window' Traceback (most recent call last):

2

#3 opened 19 days ago by

samos123

New activity in neuralmagic/granite-3.1-8b-instruct-FP8-dynamic 18 days ago

compressed-tensors MLA support requires fp8 activations and weights in group 'group_0',

2

#1 opened 19 days ago by

samos123

published a model 19 days ago

nm-testing/Yi-6B-Llama-50-quant-ds-768

Text Generation • Updated Nov 17, 2023 • 5