NousResearch

/

Hermes-3-Llama-3.1-405B-FP8

like 29

Follow

NousResearch 1.54k

i did not get performence with RDMA setup on v0.7.2 vesrion of vllm, is there any technique to improve the performence