minyichen's picture
Update README.md
66976fc verified
metadata
base_model: yentinglin/Llama-3-Taiwan-8B-Instruct
language:
  - zh
  - en
license: llama3
model_creator: yentinglin
model_name: Llama-3-Taiwan-8B-Instruct
model_type: llama
pipeline_tag: text-generation
quantized_by: minyichen
tags:
  - llama-3

Llama-3-Taiwan-8B-Instruct - GPTQ

Description

This repo contains GPTQ model files for Llama-3-Taiwan-8B-Instruct.

Quantization parameter

  • Bits : 4
  • Group Size : 128
  • Act Order : Yes
  • Damp % : 0.1
  • Seq Len : 2048
  • Size : 5.34 GB

It tooks about 50 mins to quantize on H100.