README.md · liashchynskyi/Meta-Llama-3-8B-Instruct-GGUF at main

metadata

license: apache-2.0
language:
  - en
pipeline_tag: text-generation
tags:
  - text-generation
  - gguf
  - llama
base_model: meta-llama/Meta-Llama-3-8B-Instruct
quantized_by: liashchynskyi

Description

This repository contains GGUF format model files for Meta LLama 3 Instruct.

Prompt template

<|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Same as here: https://ollama.com/library/llama3:instruct/blobs/8ab4849b038c

Downloading using huggingface-cli

First, make sure you have hugginface-cli installed:

pip install -U "huggingface_hub[cli]"

Then, you can target the specific file you need:

huggingface-cli download liashchynskyi/Meta-Llama-3-8B-Instruct-GGUF --include "meta-llama-3-8b-instruct.Q4_K_M.gguf" --local-dir ./ --local-dir-use-symlinks False