mradermacher

/

model_requests

like 68

Hi, can you guys provide quants for:

https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-70B

and

https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-72B

I'm unsure of the difference between the two models (besides the size). I know you guys create a full set of quants...but I "only" have 72GB of VRAM. So anything that would fit would be appreciated.

Thanks!