Update resampler.py

#38

by qianyuchen - opened 22 days ago

←

22 days ago

resampler.py的attn模块不适应zero3训练，在以往的finetuning脚本里只能强制性的聚拢参数，但当使用lora时这些变量名会修改，这里修改了attn模块的实现方式，主要将multihead attention的实现改成了使用直接召唤模型

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment