How an LLM is trained, stage by stage
How does a model that only continues text become one that answers you?
A chat model starts as a base model that only continues text. Training runs in stages. The first stage reads a huge pile of text. The later ones teach the model to answer you, and to answer well.
