Hugging Face's logo

mlx-community
/
gemma-2-9b-fp16

Text Generation
Transformers
Safetensors
MLX
gemma2
text-generation-inference
Inference Endpoints
Model card Files Community
2

query_pre_attn_scalar = 224?

#2
by AlexHung29629 - opened
Discussion
AlexHung29629

in https://huggingface.co/google/gemma-2-9b/blob/main/config.json

"query_pre_attn_scalar": 256,

Sign up or log in to comment