Hugging Face's logo

MaziyarPanahi
/
Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
text-generation-inference
imatrix
Model card Files Community
10

[WIP] Upload folder using huggingface_hub (multi-commit 2dbd84356136abde101a847c0c5743bfb77dd4534d055b863c10307a708e4f6f)

#3
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+10
-10
Files changed (10) hide show
  1. Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf +1 -1
  2. Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf +1 -1
  3. Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf +1 -1
  4. Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf +1 -1
  5. Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf +1 -1
  6. Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf +1 -1
  7. Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf +1 -1
  8. Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf +1 -1
  9. Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf +1 -1
  10. Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf +1 -1
Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1d7295cc6711389c49e675bcfcb59a8b2d58233f4d4ddd3d855ec0217dba6fcd
3
  size 3179131136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e8c706b71e7e98d75d1c29b429c13a7e7cc58b71ae07f666f8a4c601345d60f
3
  size 3179131136
Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee0b97c4c323ac9c126a5de41d97d7e0a2b36d66cf8d9fca31675dcb43b50ded
3
  size 4321956096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d63f1d2674d00c153c9e63e7ad3b522a7313e0eae15ce329f6ceb7962ec7fb6
3
  size 4321956096
Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3330aeb8178e3079df85958b9ae81b0c941962664301edc88781c3d900a1a700
3
  size 4018917632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17e585ae4c781a702d153877671e1a7d539d2d479a38a94c47d90c46b3a6dc62
3
  size 4018917632
Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a0b4d71710c758d9af6add267d936b86aa83f0b2d09b47913b6462bbd346fa5
3
  size 3664498944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:936fa80bddcb92beb11a9efe2c3fe1ea07923c9061c2bb21989c8e30d7daf5da
3
  size 3664498944
Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:32e4a358d92f8005f28fde76bf01afa5eb0ade29c123eb6131424d72001c772f
3
  size 4920733952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9785b690c70160cc595b2176c9ee84dab89b139f627d09ea52286484f13c3b0
3
  size 4920733952
Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ae7654257907fd4693c6540941863cc15701f27d2c895f51f0d4d64d536001e
3
  size 4692668672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdf0b7c6cafd5a0ae7e7d7e021228b83b6cf1e59526406a6f3acf0fdf6fad93e
3
  size 4692668672
Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b0d2cc5bbe727f427d159cb8ae4a004f59d0d56b73e9abd95f80915c8a535f5b
3
  size 5732987136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6851e1e2648475192766596799568b2a89faca9ac645e2d27cca84ba87b446ec
3
  size 5732987136
Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1830183332015ef51500526c68ce6124d1c599dca06139240bfdc7283b521c94
3
  size 5599293696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:989216257647920e388b17922b73f990d9c63e464492dd9eb55f4e76968e9df7
3
  size 5599293696
Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7c7e8a8d8af1d180366d455a9611e3fa633815922629be10f3ba2c190e16eb0
3
  size 6596006144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05d00998b0a2f6a678e363dd3cda64284a1a54233e44a69976a62b92ca7072af
3
  size 6596006144
Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a178e0f1d82da857cbc168eb7ae2932d910002771a1f14d6bcf10c98cb1d304c
3
  size 8540770560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e5933f73b784f48320f69d1312f967e5211de0ec941bd1985134e1c6b9244bb
3
  size 8540770560