Inference example
#1
by
royshilkrot
- opened
Hi Can you please share example code of inference with llama.cpp or llama-cpp-python? Thanks
I dont think it is runnable, since llama-cpp dosn't support its arch and tokenizer
Hi Can you please share example code of inference with llama.cpp or llama-cpp-python? Thanks
Code for llama.cpp&llama-cpp-python support is under development. Thanks for your attention