Does the visual model freeze during the pre training phase

by paul91 - opened May 23

paul91

May 23

Does the visual model freeze during the pre training phase

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org May 24

activate

zipzou

May 28

activate

Interpolate the position embedding in ViT and then finetune the whole ViT model without peft.
Is like this?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment