1. Home
  2. Glossary
  3. Fine-tuning
AI glossary · Models & training

Fine-tuning

Fine-tuning: Fine-tuning is extra training that adjusts an existing AI model's weights using a smaller, targeted set of examples so it performs better on a specific task, style, or domain. It changes the model itself, unlike prompting, which only changes the instructions.

A general model has already learned language from a huge corpus. Fine-tuning continues that training on your data: a few hundred to a few thousand examples of inputs paired with the outputs you want. The model's weights shift slightly toward your pattern, so it produces that kind of output without being told each time.

It is best for things that are hard to capture in a prompt: a very particular writing voice, a classification scheme with subtle boundaries, a strict output format that must be right every time, or a specialized vocabulary. Major API providers offer fine-tuning services, and open-weights models can be fine-tuned by a technical team.

Fine-tuning is not how you teach a model new facts. It does not give the model your knowledge base; for that, use retrieval-augmented generation. It also costs time and data preparation, and a fine-tuned model can drift out of date as the base models improve. Most teams should exhaust prompting and few-shot examples before considering it.

Example at work

An insurance company handles thousands of claim notes a day and needs each one tagged with one of forty internal loss codes. Prompting gets most of them right but stumbles on the edge cases. The data team fine-tunes a model on ten thousand historically coded notes, and the tagged results become consistent enough to automate the routine cases.

Why it matters

Vendors sometimes pitch fine-tuning as the way to make AI 'know your business.' Understanding what it actually does lets you ask the right question: is our problem about style and format (fine-tune), about access to our documents (retrieval), or about clearer instructions (prompting)?

Related terms