README.md

metadata

language:
  - en
tags:
  - fill-mask
  - roberta
widget:
  - text:"Polymerase <mask> Reaction"

PMC pretrained RoBERTa large model

Pretrained on PMC fulltext paragraphs on masked language modeling task, it's mostly biology/ medical papers