DeepSeek-Coder-V2-Lite-Instruct-GGUF

Original Model

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct

Run with Gaianet

Prompt template

prompt template: deepseek-chat-2

Context size

chat_ctx_size: 128000

Run with GaiaNet

• Quick start: https://docs.gaianet.ai/node-guide/quick-start

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quatized with llama.cpp b3212