leliuga
/

gemma-2b-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

Edit model card

gemma-2b - GGUF

Model creator: Google
Original model: gemma-2b

Description

This repo contains GGUF format model files for gemma-2b.

Downloads last month: 57

GGUF

Model size

2.51B params

Architecture

gemma

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Model tree for leliuga/gemma-2b-GGUF

Base model

google/gemma-2b

Quantized

this model

Collection including leliuga/gemma-2b-GGUF

GGUF

5 items • Updated Mar 17 • 2