Adding `safetensors` variant of these models

#1
by neggles - opened

This PR adds a safetensors variant of these models.

This is essentially identical to the PyTorch state dict file, but safe in the sense that no arbitrary code can be put into it.

These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb

also hi nubby lol <3

(what, did you think i'd just use their tool instead of hacking it up myself?)

Thanks neggles!

nubby changed pull request status to merged

Sign up or log in to comment