← Tutorials16 / 22
What is an LLM?
Base model vs chat model: what's the difference?Tap to reveal
A base model (pretraining only) continues documents. Ask it a question and it may answer, or write more questions.
Chat models get more training: 1. Supervised fine-tuning (SFT) on example conversations. 2. Preference tuning: RLHF, or simpler methods like DPO, so it prefers answers people rate as helpful, honest and harmless.