Transformers
English
code
Inference Endpoints

demo space

#4
by matthoffner - opened

I've put together a demo using the 4 bit quantized version running on a CPU upgrade space.

UI - https://huggingface.co/spaces/matthoffner/starchat-alpha-ui
API - https://huggingface.co/spaces/matthoffner/starchat-alpha

Thanks!

Cool! Will try it.

Looks very nice, thank you!

Sign up or log in to comment