RAM requirements for this models

by Ashish098765 - opened May 13

May 13

Hello,

I am using this QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2 So how much RAM required to load this model.Because there is not mentioned RAM requirements for each quantization model

Ashish098765 changed discussion status to closed May 13

Ashish098765 changed discussion status to open May 13

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment