longer context version

#9
by LaferriereJC - opened

infini attention?

infiniTransformer/train.llama.infini.noclm.py at main 路 Beomi/InfiniTransformer

Cognitive Computations org

Not in scope for this model, might look into it in the future

ehartford changed discussion status to closed
Cognitive Computations org

There's RoPE

Sign up or log in to comment