README.md

metadata

base_model:
  - CohereForAI/c4ai-command-r-plus
library_name: gguf
tags:
  - mergekit
  - merge
language:
  - en
  - fr
  - de
  - es
  - it
  - pt
  - ja
  - ko
  - zh
  - ar
pipeline_tag: text-generation
license: cc-by-nc-4.0

Megac4ai-command-r-plus-gguf

These are quantized GGUF versions of nitky/Megac4ai-command-r-plus. Please check the original model for license and more details.

Results for non-English languages (Japanese)

Model	Output Quality	Notes
Megac4ai-command-r-plus-IQ3_XS.gguf	Poor
Megac4ai-command-r-plus-IQ4_XS.gguf	Average
Megac4ai-command-r-plus-Q4_K_M.gguf	Good	recommended
Megac4ai-command-r-plus-Q5_K_M.gguf	Good
Megac4ai-command-r-plus-Q6_K.gguf	Excellent	recommended
Megac4ai-command-r-plus-Q8_0.gguf	Excellent