README.md

metadata

license: mit
pipeline_tag: feature-extraction

This repository contains the GPT-Soft-1.2b model described in Cottention: Linear Transformers With Cosine Attention.