What GPU and RAM is needed for Llama-2-70B-chat-70B（int 8 or fp16） ?

#33

by yanmengxiang666 - opened Aug 14, 2023

Aug 14, 2023

I want to know int 8 or fp16 in Llama-2-70B-chat-70B. Thanks!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment