gmongaras
/

Softmax_Attention_BERT

Feature Extraction

Model card Files Files and versions Community

Edit model card

This repository contains the BERT-Soft model described in Cottention: Linear Transformers With Cosine Attention.

Downloads last month: 6

Inference Examples

Feature Extraction

Unable to determine this model's library. Check the docs .

Collection including gmongaras/Softmax_Attention_BERT

Cosine Attention (Cottention)

Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747 • 6 items • Updated 9 days ago