extended context
#1
by
lucyknada
- opened
is it planned to scale up the new 9b to 200k or at least 32k? thank you!
+1 average coding based RAG requires atleast 16K, 64K is sweet point covering more than 95% of my requests as analyzed by logs. hope others have same opinions.
on the way, please stay tuned
16k chat and 32k base is out.
lorinma
changed discussion status to
closed