Transformers 4.39.0.dev0 Framework
When Transformers 4.39.0.dev0 gets updated later to a new stable release, do you think there might be any difficulties in making sure Zephyr 7B Gemma continues to work well? I'm curious if starting with Transformers 4.39.0.dev0 could cause any issues down the line.
Hi
@Taylor658
, indeed the 4.38.2 version was used, but due to the issues within Google's Gemma and RoPE, transformers
was being installed from source, but you're safe to pin it to 4.38.2
to be able to reproduce 1:1 the results they got with zephyr-7b-gemma-v0.1
π€
See the transformers v4.38.2
release notes at https://github.com/huggingface/transformers/releases/tag/v4.38.2
Hi @Taylor658 , indeed the 4.38.2 version was used, but due to the issues within Google's Gemma and RoPE,
transformers
was being installed from source, but you're safe to pin it to4.38.2
to be able to reproduce 1:1 the results they got withzephyr-7b-gemma-v0.1
π€See the
transformers v4.38.2
release notes at https://github.com/huggingface/transformers/releases/tag/v4.38.2
Ok that makes sense...thanks