Hi There Nouamane! If you look at the SFTTrainer doc string it should clarify things for you. Basically it’s a Trainer subclass and let’s you define a peft model easily https://github.com/huggingface/trl/blob/main/trl/trainer/sft_trainer.py