Transfer learning: Transfer learning reuses a model trained on one large task as the starting point for a different, usually smaller task, so the new model needs far less data and computing. It is the reason a general-purpose AI model can be adapted to your specific work.
Training a capable model from scratch takes enormous amounts of data and hardware. Transfer learning skips most of that. A model that has already learned general patterns, such as what edges and textures look like in photos or how English sentences are built, is taken as a base and then adjusted on a much smaller set of examples for the job you actually care about.
The classic case is vision: a network trained on millions of everyday photos gets retrained with a few hundred pictures of your product line and learns to spot defects. The same logic underlies every fine-tuned language model. A foundation model that has read a large slice of the internet is nudged with a few thousand of your support transcripts and starts answering in your company's voice, with your product names right.
Two limits to keep in mind. First, what transfers is general knowledge; the base model has never seen your data, so everything specific still has to come from your examples or your prompt. Second, whatever the base model absorbed comes along for the ride, including its biases and habits, and those can be hard to see in a small evaluation. Test the adapted model on cases that look like real work before trusting it.
Example at work
A quality engineer at a packaging plant has 400 photos of good seals and 120 of bad ones, nowhere near enough to train a vision model from nothing. Starting from a general image model and fine-tuning on those photos produces a defect detector that catches most bad seals on the line within a week of setup, and it improves as operators flag the misses.
Why it matters
Transfer learning is why small companies can use AI at all: you inherit years of expensive training and pay only for the last mile. It is also why "custom AI" claims deserve a question: what was the base, and what did you actually add?
Related terms
- Fine-tuningFine-tuning is extra training that adjusts an existing AI model's weights using a smaller, targeted set of examples so it performs better on a specific task, style, or domain. It changes the model itself, unlike prompting, which only changes the instructions.
- Pre-trainingPre-training is the first and largest phase of building an AI model, in which it learns general patterns from a massive dataset, such as predicting the next word across trillions of words of text. Later phases then shape it into a useful assistant.
- Foundation modelA foundation model is a large AI model trained on broad, general data that can be adapted to many different tasks, rather than built for a single purpose. Most of today's chat assistants, image generators, and coding tools are built on one.
- Machine learning (ML)Machine learning is the branch of AI in which software learns patterns from examples instead of following rules a programmer wrote by hand. Nearly every modern AI tool, including chat assistants, is built on it.
- Deep learningDeep learning is machine learning that uses neural networks with many layers, which lets a model learn complex patterns directly from raw data such as text, images, or audio. It is the technique behind today's language models and image generators.