Can you make a fusionnet 34b moe model, 24gb of video memory is too much of a strain to run a 34BX2 model

by xldistance - opened Jan 23

Jan 23

Thanks for sharing

TomGrc

Owner Jan 24

I will consider that.

TomGrc changed discussion status to closed Mar 4

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment