FP16

by bsbsbsbs112321 - opened Aug 1

Aug 1

Thanks for the version!
Is it possible to make a fp16 version? For some reason original bf16 is taking 40gb+ of RAM on MacOS.

Aug 4

Would also love to see this

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment