metadata

tags:
  - llama2
  - llama2-13b
  - rkllm
  - rockchip
  - rk3588

Llama 2 Chat 13B for RK3588

This is a conversion from https://huggingface.co/meta-llama/Llama-2-13b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.

Latest update: April 2024. Converted with RKLLM runtime 1.0.0. Not compatible with newer versions

Main repo

See this for my full collection of converted LLMs for the RK3588's NPU:

Same as the original LLM: