Can this be used with the TGI docker (which supposedly includes extllamav2?) - can you provide a command line to launch a container (on a non-Ampere GPU...)? Thank you.
· Sign up or log in to comment
