Fine-tuning and parameter-efficient adaptation: Deep Learning course | Zoonk
44. Fine-tuning and parameter-efficient adaptation
Adapt pretrained models with supervised fine-tuning, instruction tuning, preference optimization, low-rank adaptation, adapters, and quantization-aware methods. Prepare training data and detect catastrophic forgetting or capability regression.