RWKV-GGUF - a RachidAR Collection

RachidAR 's Collections

Papers

Ternary LLMs & Knowledge distillation & SOTA

SOTA architecture

RWKV-GGUF

updated 12 days ago

EDIT: All quants work if you pass "--no-warmup" parameter.

RachidAR/RWKV-v6-Finch-1B6-HF-Q5_K_M-GGUF

Updated 15 days ago • 109 • 1

Note Works with CUDA and CPU backend
RachidAR/RWKV-v6-Finch-14B-HF-Q5_K_M-GGUF

Updated 15 days ago • 23

Note Works only with "--no-warmup" parameter.
RachidAR/RWKV-v6-Finch-7B-HF-Q5_K_M-GGUF

Updated 15 days ago • 22

Note Works only with "--no-warmup" parameter.