Will Reynolds's picture

5 7

Will Reynolds

willowill5

·

AI & ML interests

LLMs, Talking Head Animation

Organizations

None yet

willowill5's activity

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 7 months ago

OOM with vllm

#48 opened 7 months ago by

New activity in TheBloke/zephyr-7B-beta-AWQ 7 months ago

vLLM out of memory

#2 opened 8 months ago by

New activity in TheBloke/zephyr-7B-alpha-AWQ 8 months ago

OOM on RTX 3090 with vLLM

#1 opened 8 months ago by

New activity in TheBloke/Falcon-180B-Chat-AWQ 9 months ago

Quantization not recognized, even when building VLLM from source

#1 opened 9 months ago by

New activity in TheBloke/Falcon-180B-Chat-GPTQ 9 months ago

very slow inference speed on 2x A100 80GB with 4-bit (main branch)

#6 opened 9 months ago by