winglian's picture TheBloke's picture
Set use_cache to True, otherwise inference performance is poor (#2)
64c10ed