Generative AI and Language Models
Pretraining and Post-training
From general pattern learning to a useful instruction-following model.
In this lesson
Lesson goals
- Broad pretraining
- Instruction tuning
- Feedback and safety evaluation
Core idea
From general pattern learning to a useful instruction-following model.
1. Broad pretraining: understand it in context, identify inputs and outputs, and define how the result will be verified.
2. Instruction tuning: understand it in context, identify inputs and outputs, and define how the result will be verified.
3. Feedback and safety evaluation: understand it in context, identify inputs and outputs, and define how the result will be verified.
Practical example
Consider a real application of “Pretraining and Post-training.” Start small, identify available data, and compare the system with a clear baseline before expanding it.
Check your understanding
- Explain “Pretraining and Post-training” in your own words.
- Give one appropriate and one misleading application.
- What risk or limitation should be monitored?