What is Fine-Tuning?
Fine-tuning is further training of an existing language model on a set of example inputs and outputs, so it adopts a specific style, format or classification behaviour by default. Train one on 500 of your own past support replies and it writes in your house tone. Fine-tuning teaches patterns, not facts.
- Category
- AI & Automation
- Also called
- Model fine-tuning, Supervised fine-tuning
The distinction that saves money is between behaviour and knowledge. Fine-tuning shifts behaviour: output that always parses as the same structure, a fixed reply format, reliable sorting of messages into eight categories, a voice matching the rest of your writing. It is a poor way to install facts, because a fact learned this way cannot be edited without training again and cannot be cited when the model uses it.
The prerequisite is data that most small businesses have not collected yet: several hundred clean, consistent examples of the input and the ideal output, prepared by someone who knows what good looks like. Assembling that set is usually the largest part of the work. Prompting and retrieval are cheaper first attempts, and both are worth exhausting before paying to train, since a well-written prompt closes most of the gap for style alone.
Common questions.
Do we need to fine-tune a model to use AI in our business?
Rarely, and almost never first. Clear prompting handles tone and format for most cases, and retrieval handles company facts. Fine-tuning becomes worthwhile when a task repeats at volume and needs output identical in shape every time, or when a smaller, cheaper model has to match a larger one on a narrow job.
Where it comes up.
RAG or Fine-Tuning? Picking the Right AI Approach for Your Business Data
ArticleRAG vs fine tuning Philippines: an honest 2026 breakdown for SMEs choosing how to connect business data to AI without wasting budget on the wrong approach.
Two Years of AI in Production: What Actually Works
ArticleLooking back at two years of shipping AI features inside real products. What we kept, what we threw away, and what we tell every founder asking us to add AI to their business in 2024.
ChatGPT Just Changed Our Studio. Here Is What We Are Doing About It
ArticleThree months into the GPT-4 era, the way we scope, design, and build software at Blackbyrds Digital has shifted. An honest write-up of what is working, what is not, and what we are betting on next.
Related terms.
Large Language Model (LLM)
AI & AutomationA large language model is a neural network trained on large volumes of text to predict likely continuations, which lets it write, summarise, classify and translate without being programmed for each task.
Retrieval-Augmented Generation (RAG)
AI & AutomationRetrieval-augmented generation is a technique that searches a private collection of documents for passages relevant to a question, then passes those passages to a language model as context for its answer.
Prompt Engineering
AI & AutomationPrompt engineering is the practice of writing model instructions that produce the required output reliably: stating the role, the task, the constraints, the output format, and one or two worked examples.
Inference Cost
AI & AutomationInference cost is what a business pays each time a model produces an output, billed by most providers per token of input and output, where a token is roughly three-quarters of a word.
Scoping a project?
Reading definitions because you are scoping a project? Skip ahead and just ask.