|
--- |
|
license: apache-2.0 |
|
tags: |
|
- video LLM |
|
datasets: |
|
- OpenGVLab/VideoChat2-IT |
|
--- |
|
|
|
|
|
# PLLaVA Model Card |
|
## Model details |
|
**Model type:** |
|
PLLaVA-7B is an open-source video-language chatbot trained by fine-tuning Image-LLM on video instruction-following data. It is an auto-regressive language model, based on the transformer architecture. Base LLM: llava-hf/llava-v1.6-vicuna-7b-hf |
|
|
|
**Model date:** |
|
PLLaVA-7B was trained in April 2024. |
|
|
|
**Paper or resources for more information:** |
|
- github repo: https://github.com/magic-research/PLLaVA |
|
- project page: https://pllava.github.io/ |
|
- paper link: https://arxiv.org/abs/2404.16994 |
|
|
|
## License |
|
llava-hf/llava-v1.6-vicuna-7b-hf license. |
|
|
|
**Where to send questions or comments about the model:** |
|
https://github.com/magic-research/PLLaVA/issues |
|
|
|
## Intended use |
|
**Primary intended uses:** |
|
The primary use of PLLaVA is research on large multimodal models and chatbots. |
|
|
|
**Primary intended users:** |
|
The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence. |
|
|
|
## Training dataset |
|
Video-Instruct-Tuning data of OpenGVLab/VideoChat2-IT |
|
## Evaluation dataset |
|
A collection of 6 benchmarks, including 5 VQA benchmarks and 1 recent benchmarks specifically proposed for Video-LMMs. |
|
|
