PrunaAI
/

Meta-Llama-3-8B-Instruct-GGUF-Imatrix-smashed

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-GGUF-Imatrix-smashed

2 contributors

History: 11 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload Meta-Llama-3-8B-Instruct.IQ4_XS.gguf with huggingface_hub

059afc9 verified 6 months ago

.gitattributes

2.24 kB

Upload Meta-Llama-3-8B-Instruct.IQ4_XS.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ1_S.gguf

2.02 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ1_S.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ2_M.gguf

2.95 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ2_M.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ2_S.gguf

2.76 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ2_S.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ3_XS.gguf

3.52 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ3_XS.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ4_NL.gguf
4.68 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ4_NL.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.IQ4_XS.gguf
4.45 GB
LFS

Upload Meta-Llama-3-8B-Instruct.IQ4_XS.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.Q3_K_L.gguf
4.32 GB
LFS

Upload Meta-Llama-3-8B-Instruct.Q3_K_L.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.Q3_K_M.gguf

4.02 GB
LFS

Upload Meta-Llama-3-8B-Instruct.Q3_K_M.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.Q4_0.gguf
4.68 GB
LFS

Upload Meta-Llama-3-8B-Instruct.Q4_0.gguf with huggingface_hub 6 months ago
Meta-Llama-3-8B-Instruct.Q4_K_M.gguf
4.92 GB
LFS

Upload Meta-Llama-3-8B-Instruct.Q4_K_M.gguf with huggingface_hub 6 months ago