Hugging Face's logo

MaziyarPanahi
/
gemma-7b-it-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
conversational
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
2

Upload folder using huggingface_hub

#1
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+22
-22
Files changed (11) hide show
  1. gemma-7b-it.Q2_K.gguf +2 -2
  2. gemma-7b-it.Q3_K_L.gguf +2 -2
  3. gemma-7b-it.Q3_K_M.gguf +2 -2
  4. gemma-7b-it.Q3_K_S.gguf +2 -2
  5. gemma-7b-it.Q4_K_M.gguf +2 -2
  6. gemma-7b-it.Q4_K_S.gguf +2 -2
  7. gemma-7b-it.Q5_K_M.gguf +2 -2
  8. gemma-7b-it.Q5_K_S.gguf +2 -2
  9. gemma-7b-it.Q6_K.gguf +2 -2
  10. gemma-7b-it.Q8_0.gguf +2 -2
  11. gemma-7b-it.fp16.gguf +2 -2
gemma-7b-it.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:42da10502fd6ed21f1f12ea89f5ba3af09595cf064280ae7a7c7a20612331446
3
- size 3094507680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80cf76ca4b8dc49fe7eb553fdb8cf817b59155b2e65ca0da39f98733e4d0b35d
3
+ size 3481447424
gemma-7b-it.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24d502df64ae27dc02e44567463184d9a00e433c02c73867dbe653d4dc3ed346
3
- size 4402039968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1507372e8a04bf4b772bab4123213bdd786d83ed7573390ae6f80f02deba7ae
3
+ size 4709067776
gemma-7b-it.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:339f8d1ad6dcea6308310d401cb39b42ce781acd8b31fc65a9d49ee74aae1af1
3
- size 4062301344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cff420b91b4a0f15e4523f1d91f29e30ddaf26ad966a3a8f85b350cc5a356ff4
3
+ size 4369329152
gemma-7b-it.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ccb60c83b6aa7065233dd06f2466461317866de507435c9c4a565607edb8978
3
- size 3675376800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c048daf49075e305957670314a2914a23bc396a840b52e88083cbf88864a0af1
3
+ size 3982404608
gemma-7b-it.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd87fc03fe3d651ac419ae35f4a0e6d861167db156572b6c4b90fb81822a3547
3
- size 5127231648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcc3a248efa052923be7cdae024f63dfb2623ffd6e73735b1a6684ead653ae82
3
+ size 5329759232
gemma-7b-it.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2b485d0a4e68fcb01a6265b5d1373bcb08f8cc9f27b177add95134bf05fab87
3
- size 4843919520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:235502ec230fd4ae1eb5fcb7ffa1f0e6df24c955ad6206ec540ca4142bd8f67a
3
+ size 5046447104
gemma-7b-it.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:601ea5510042eb36434b85c024f8182350ed9b96b2efeee0157c8035a9042b79
3
- size 6040328352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b04f9d8397f420a6ad34f965cf4950d4c83c4d125ae0e280675015c3c9ca4b8
3
+ size 6144502784
gemma-7b-it.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22d126be2d6a308c9c95dbcc667db20c55ee12cff9eb56529ad680dac94d12bd
3
- size 5876553888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0694074cddc57eda89c56fc25557283edefe99e7479bd26239faa8974a50fa8
3
+ size 5980728320
gemma-7b-it.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06c44fb30feac4c7d681baf4c68e9d2df45fe624ce22f3a9bad45a8de711dd32
3
- size 7010493600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8641505d635e81b44e40a33e8e49f1953fc825724ab80cb9c28c4eac0bd92c5e
3
+ size 7010167808
gemma-7b-it.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6daf2627518df1d55e8d8c8ca874909cb4f69f4ab863bffc7a0bb7636509bbb6
3
- size 9078266016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbb25e66046bd64d654faab6a215bd543c1f1b0bc288f38a800c82845c0f673d
3
+ size 9077844992
gemma-7b-it.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82ed67cc4c2d9384a67cedd8b07950b71fa06e4a2e0c6ae9cabfad094d67e234
3
- size 34158344288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48527ba79402c0238babcd85db5c2d880c10ff70edde04f3d9f3c25453dd8efd
3
+ size 17081756608