Hugging Face's logo

4darsh-Dev
/
Meta-Llama-3-8B-quantized-GPTQ

Text Generation
PEFT
English
llama
llama-3-8b
llama-3-8b-quantized
llama-3-8b-autogptq
meta
quantized
4-bit precision
gptq
Model card Files Community
Edit model card

Model Card for 4darsh-Dev/Meta-Llama-3-8B-autogptq-4bit

This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B

Model Details

Downloads last month
0
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.