Gabriel Mongaras

gmongaras's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

updated 6 models about 2 months ago

gmongaras/Softmax_Attention_BERT

Feature Extraction • Updated Oct 7 • 6

gmongaras/Cosine_Attention_BERT

Feature Extraction • Updated Oct 7 • 6

gmongaras/Cosine_Attention_GPT_1.2B

Feature Extraction • Updated Oct 7 • 3

gmongaras/Cosine_Attention_GPT_300M

Feature Extraction • Updated Oct 7 • 2

gmongaras/Softmax_Attention_GPT_1.2B

Feature Extraction • Updated Oct 7 • 1

gmongaras/Softmax_Attention_GPT_300M

Feature Extraction • Updated Oct 7 • 2

New activity in gmongaras/Cosine_Attention_GPT_300M about 2 months ago

Add pipeline tag, link to paper

1

#1 opened about 2 months ago by nielsr

commented a paper about 2 months ago

Cottention: Linear Transformers With Cosine Attention

Paper • 2409.18747 • Published Sep 27 • 15 •

4

updated a collection about 2 months ago

Cosine Attention (Cottention)

Collection

Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747 • 6 items • Updated Oct 7