|
--- |
|
license: bsd-3-clause |
|
datasets: |
|
- ILSVRC/imagenet-1k |
|
--- |
|
|
|
# Model Card |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
ImageNet-1k DeiT-iii pre-trained model with Rotary Position Embedding |
|
|
|
## Rotary Position Embedding for Vision Transformer [ECCV 2024] |
|
|
|
- **Repository:** https://github.com/naver-ai/rope-vit |
|
- **Paper:** https://arxiv.org/abs/2403.13298 |
|
|
|
|
|
## Citation |
|
|
|
``` |
|
@inproceedings{heo2024ropevit, |
|
title={Rotary Position Embedding for Vision Transformer}, |
|
author={Heo, Byeongho and Park, Song and Han, Dongyoon and Yun, Sangdoo}, |
|
year={2024}, |
|
booktitle={European Conference on Computer Vision (ECCV)}, |
|
} |
|
``` |
|
|
