Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2-7B-Instruct-GGUF
like
7
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
imatrix
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Qwen2-7B-Instruct-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
e4bd92469eb02f6a9476f5b10d2a45654405eda6d11db3a7c95f280f25355e2b
2efc53a
verified
3 months ago
.gitattributes
2.57 kB
e4bd92469eb02f6a9476f5b10d2a45654405eda6d11db3a7c95f280f25355e2b
3 months ago
Qwen2-7B-Instruct.IQ1_M.gguf
2.04 GB
LFS
9e58b7c5d0b4d29ab66ca9f435a40b0a0ba886168b3480574a78565f7873fb05
3 months ago
Qwen2-7B-Instruct.IQ1_S.gguf
1.9 GB
LFS
e4bd92469eb02f6a9476f5b10d2a45654405eda6d11db3a7c95f280f25355e2b
3 months ago
Qwen2-7B-Instruct.IQ2_XS.gguf
2.47 GB
LFS
f04a6bde3f3f8d2d84cb5246003212b1be47f2fb344171d8bf30c77881667260
3 months ago
Qwen2-7B-Instruct.IQ3_XS.gguf
3.35 GB
LFS
3652b1f7837366ac52c96f7de535a868a66004447b1478baf7fecc8887d3a3c0
3 months ago
Qwen2-7B-Instruct.IQ4_XS.gguf
4.22 GB
LFS
e28c4f05f7c746f3b5977e2d514b71fd81a7eb8224d59f5275e854c230038bd3
3 months ago
Qwen2-7B-Instruct.Q2_K.gguf
3.02 GB
LFS
3f9718ea0f926f6953cfe543f0d00f200c35ce05ed2835b8bca4adb9c4e2fc86
3 months ago
Qwen2-7B-Instruct.Q3_K_L.gguf
4.09 GB
LFS
e401f648ae9014eac55afaf2b6c8e26499402838f7a3b38642e8a7d7091c0981
3 months ago
Qwen2-7B-Instruct.Q3_K_M.gguf
3.81 GB
LFS
9a99dd6d203734faaba580e657e1fa2276cdecdc5210aa9331d57dff5a83dbe7
3 months ago
Qwen2-7B-Instruct.Q3_K_S.gguf
3.49 GB
LFS
a495a1a2cc7a4128aeebc5202c05c90382b9a54ce6b09170a7c98dcf264dcc00
3 months ago
Qwen2-7B-Instruct.Q4_K_M.gguf
4.68 GB
LFS
1ee0b03584871f30b25f1728f35c471ac4c9dfa2332ed5125f7eef51ef5e7a5f
3 months ago
Qwen2-7B-Instruct.Q4_K_S.gguf
4.46 GB
LFS
0f6084c29928818805101c44e26932dccbdb04723fc9086125385b7e1a36f733
3 months ago
Qwen2-7B-Instruct.Q5_K_M.gguf
5.44 GB
LFS
d83476a0aea85f333bd34bd2a592424922b361b07bc07eb64a6a5743a3fc2cd3
3 months ago
Qwen2-7B-Instruct.Q5_K_S.gguf
5.32 GB
LFS
ccef74d008147a58053d3854fbd411a40459b9a07ea891f9f141cc7a78e8bb32
3 months ago
Qwen2-7B-Instruct.Q6_K.gguf
6.25 GB
LFS
9dc4a521cb9ea4f7d08bb70afce60e37dd1066664706d9508ed6d3847329ca81
3 months ago
Qwen2-7B-Instruct.Q8_0.gguf
8.1 GB
LFS
17a4dcd289efa2a45692aa42aa59dedb25e7b4874c78b8e5ea0495a882f92a4f
3 months ago
Qwen2-7B-Instruct.fp16.gguf
15.2 GB
LFS
a4e0f3ec7618d2ec394a0168c6cab2988ca75b84e3ad72196b55da58fa02db19
3 months ago
README.md
2.94 kB
e4bd92469eb02f6a9476f5b10d2a45654405eda6d11db3a7c95f280f25355e2b
3 months ago
