the model class needs to implement the `_no_split_modules` attribute
#1
by
entin
- opened
Sziasztok / Hi,
Is there a workaround regarding this error?
env .. python3.12/site-packages/transformers/modeling_utils.py", line 1867, in _get_no_split_modules
raise ValueError(
ValueError: BertLMHeadModel does not support device_map='auto'. To implement support, the model class needs to implement the _no_split_modules attribute.