Demo Code
#1
by
zhezh
- opened
Hi, jina team, it is interesting work to use llm for segmenting articles.
I have successfully loaded the model, but cannot figure out how to do the segmentation.
Could you please kindly provided a demo code snippet？（maybe the prompt, decoding process）
Thanks!
Sure you can check this colab here: https://colab.research.google.com/drive/1LlCUK3k02UqyR23KEw9ggt6bnYCdKgdH?usp=sharing
Basically, make sure you use the correct prompt template for the model you are targeting, let me know if you need more help.