Why were the quants updated 3 hours ago?

#6
by Hugman2345 - opened

I just downloaded the Q4_M quant to use with KoboldCPP, However while verifying the hash I found all quants updated 3 hours ago, Was there a bug in the previous quants?

Thanks in advance!

They updated the chat template, if you aren't using it you shouldn't have any issue, but yeah there was a small bug where if you used the chat template and didn't define the tools it wouldn't work

They updated the chat template, if you aren't using it you shouldn't have any issue, but yeah there was a small bug where if you used the chat template and didn't define the tools it wouldn't work

I have a small suggestion that could help clarify confusion during model file reuploads:

When a model file is reuploaded, add an "Updates" section to the model card. This section should specify when the reupload occurred and the reason for it. If the update only involves metadata, users with slow or limited internet connections can update their already downloaded model files using the gguf_set_metadata.py utility without needing to redownload the entire file.

I've personally encountered this issue several times, so I believe this change would be beneficial.
Thank you for your hard work!

Yeah I probably should incorporate that, currently the entire readme is auto generated but I'll look into an updates section soon enough

Thanks for the clarification!

Hugman2345 changed discussion status to closed

Sign up or log in to comment