Help request with LazyMergeKit for Falcon 7B

#18
by alielfilali01 - opened

Hi @mlabonne , I'am trying to make a MoE out of Falcon 7B just as a toy weekend project using your notebook LazyMergeKit and got into this error and i'am wondering if you happen to know any work around !? someway to fix that ?
Thanks in advance and looking forward to hear back from you again πŸ€—

image.png

Sign up or log in to comment