Fine-tuning or RAG: which one you need

What does fine-tuning change in a model, and when is it worth doing?

Fine-tuning · about 5 minutes

Fine-tuning is a little more training for a model that's already trained, on your own examples. It teaches a habit: a format, a tone, one kind of task. Try a better prompt before you reach for it. When the model needs your facts, let it look them up instead. That's RAG.

Sketch: Xiaohei at a small desk copies the same line from a short stack of cards marked "your examples" into a notebook; behind it stands a closed library marked "what it already learned"