← Tutorials16 / 22

What is an LLM?

Base model vs chat model: what's the difference?Tap to reveal

A base model (pretraining only) continues documents. Ask it a question and it may answer, or write more questions.

Chat models get more training: 1. Supervised fine-tuning (SFT) on example conversations. 2. Preference tuning: RLHF, or simpler methods like DPO, so it prefers answers people rate as helpful, honest and harmless.

← PreviousNext card →