ValueError: `.to` is not supported for `4-bit` or `8-bit` bitsandbytes models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct `dtype`.
解决方案:将 accelerate 下降版本到 0.26.0
pip install accelerate==0.26.0
没有回复内容