Benjamin Bossan bcc50cc7ce [PEFT] Better Trainer error when prompt learning with loading best model at the end (#35087) ... Original issue: https://github.com/huggingface/peft/issues/2256 There is a potential error when using load_best_model_at_end=True with a prompt learning PEFT method. This is because Trainer uses load_adapter under the hood but with some prompt learning methods, there is an optimization on the saved model to remove parameters that are not required for inference, which in turn requires a change to the model architecture. This is why load_adapter will fail in such cases and users should instead set load_best_model_at_end=False and use PeftModel.from_pretrained. As this is not obvious, we now intercept the error and add a helpful error message.		2024-12-11 12:44:39 +01:00
..
test_peft_integration.py	[PEFT] Better Trainer error when prompt learning with loading best model at the end (#35087)	2024-12-11 12:44:39 +01:00