2 contributors

History: 28 commits

bartowski

Upload granite-20b-code-instruct.imatrix with huggingface_hub

afd1655 verified about 1 month ago

granite-20b-code-instruct-f32.gguf
Llamacpp quants 5 months ago
.gitattributes

4.31 kB

Upload granite-20b-code-instruct-f16.gguf with huggingface_hub about 1 month ago
README.md

12.9 kB

Update README.md (#1) 4 months ago
granite-20b-code-instruct-IQ1_M.gguf
4.91 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ1_S.gguf
4.52 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ2_M.gguf
7.05 GB
LFS

Upload granite-20b-code-instruct-IQ2_M.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-IQ2_S.gguf
6.53 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ2_XS.gguf
6.16 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ2_XXS.gguf
5.57 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ3_M.gguf
9.59 GB
LFS

Upload granite-20b-code-instruct-IQ3_M.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-IQ3_S.gguf
8.93 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ3_XS.gguf
8.66 GB
LFS

Upload granite-20b-code-instruct-IQ3_XS.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-IQ3_XXS.gguf
8.06 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ4_NL.gguf
11.6 GB
LFS

Llamacpp quants 5 months ago
granite-20b-code-instruct-IQ4_XS.gguf
10.9 GB
LFS

Upload granite-20b-code-instruct-IQ4_XS.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q2_K.gguf
7.93 GB
LFS

Upload granite-20b-code-instruct-Q2_K.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q2_K_L.gguf
8 GB
LFS

Upload granite-20b-code-instruct-Q2_K_L.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q3_K_L.gguf
11.7 GB
LFS

Upload granite-20b-code-instruct-Q3_K_L.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q3_K_M.gguf
10.6 GB
LFS

Upload granite-20b-code-instruct-Q3_K_M.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q3_K_S.gguf
8.93 GB
LFS

Upload granite-20b-code-instruct-Q3_K_S.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q3_K_XL.gguf
11.8 GB
LFS

Upload granite-20b-code-instruct-Q3_K_XL.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_0.gguf
11.6 GB
LFS

Upload granite-20b-code-instruct-Q4_0.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_0_4_4.gguf
11.6 GB
LFS

Upload granite-20b-code-instruct-Q4_0_4_4.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_0_4_8.gguf
11.6 GB
LFS

Upload granite-20b-code-instruct-Q4_0_4_8.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_0_8_8.gguf
11.6 GB
LFS

Upload granite-20b-code-instruct-Q4_0_8_8.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_K_L.gguf
12.9 GB
LFS

Upload granite-20b-code-instruct-Q4_K_L.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_K_M.gguf
12.8 GB
LFS

Upload granite-20b-code-instruct-Q4_K_M.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q4_K_S.gguf
11.7 GB
LFS

Upload granite-20b-code-instruct-Q4_K_S.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q5_K_L.gguf
14.9 GB
LFS

Upload granite-20b-code-instruct-Q5_K_L.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q5_K_M.gguf
14.8 GB
LFS

Upload granite-20b-code-instruct-Q5_K_M.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q5_K_S.gguf
14 GB
LFS

Upload granite-20b-code-instruct-Q5_K_S.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q6_K.gguf
16.6 GB
LFS

Upload granite-20b-code-instruct-Q6_K.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q6_K_L.gguf
16.7 GB
LFS

Upload granite-20b-code-instruct-Q6_K_L.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-Q8_0.gguf
21.5 GB
LFS

Upload granite-20b-code-instruct-Q8_0.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct-f16.gguf
40.2 GB
LFS

Upload granite-20b-code-instruct-f16.gguf with huggingface_hub about 1 month ago
granite-20b-code-instruct.imatrix

8.95 MB
LFS

Upload granite-20b-code-instruct.imatrix with huggingface_hub about 1 month ago