About pooler_type

#12
by huaanrui - opened

Hey! I use this model in transformers AutoModelForSequenceClassification. By default, it uses Bertconfig, and uses the cls token for sentence embedding. In the config.json file, I find "pooler_type": "first_token_transform", while in ./1_Pooling/config.json, "pooling_mode_mean_tokens": true, it seems like you use mean pooler. So what is the final pooler type? Thank you!

Sign up or log in to comment