Hugging Face's logo
Bowen Peng's picture
TFLOPS icon 623.8 TFLOPS
4 13 30

Bowen Peng

bloc97
21world's profile picture lukaemon's profile picture m4s1t4's profile picture
·

AI & ML interests

Machine Learning, Computer Graphics, Language Models

Organizations

NousResearch's profile picture

bloc97's activity

New activity in NousResearch/Nous-Capybara-34B 6 months ago

How did you train this without going OOM in RAM & VRAM?

3
#15 opened 6 months ago by vicplus
New activity in NousResearch/Yarn-Mistral-7b-128k 10 months ago

VRAM usage for full 128k tokens

7
#5 opened 11 months ago by Hypersniper
New activity in NousResearch/Yarn-Mistral-7b-128k 11 months ago

sliding_window = 131072? Sliding window attention doesn't work for 128?

1
#4 opened 11 months ago by keyishen
New activity in NousResearch/Yarn-Llama-2-13b-64k about 1 year ago

Hardware requirements for the model.

2
#1 opened about 1 year ago by Sc0urge