Fine-Tuning
fine-tuning
Practice Problems
Fine-Tuning Dataset Validator
Validate a supervised fine-tuning dataset before training: exactly three splits, unique IDs, chat rows that end in an assistant target, and no exercise family or whitespace-normalized conversation shared between splits.
AI Engineering
Decide whether to fine-tune
Decide whether a feedback assistant's failures call for prompting, retrieval, or fine-tuning, and explain the reviewed data, grouped split, and baseline comparison that fine-tuning would need.
Validate a fine-tuning dataset and plan SFT
Implement a split validator for a fine-tuning dataset, predict its results on fixture cases, find the leaks it cannot catch, and plan a supervised fine-tuning experiment against a prompted baseline.
Design a model specialization program
Design a specialization program for a fictional hint model within GPU-hour and expert-review budgets: choose learning signals and parameterization, protect splits and evaluation, and plan a release with rollback. Then investigate a candidate that won a preference comparison while experts found wrong explanations.
