---
library_name: transformers
tags: []
---

# Model Card for nbroad/xlm-roberta-large-2048
<!-- Provide a quick summary of what the model is/does. -->

Same as [xlm-roberta-large](https://huggingface.co/FacebookAI/xlm-roberta-large), but with position embeddings that can accommodate 2048 tokens.

See [this notebook](https://huggingface.co/nbroad/xlm-roberta-large-2048/blob/main/convert_to_long.ipynb) for how it was created.