Red Hat Blog: What is parameter-efficient fine-tuning (PEFT)?

Adding adapters: Think of adapters like an expansion pack for a board game. Adapters are added on top of the layers within the pre-trained model and trained to learn domain- or application-specific information. In this scenario, the original model doesn’t change, but gains new capabilities.