Skip to content
ForklabsTechnologies
Soft textured page header background

12 August 2026

RAG first, fine-tune when the eval says so

Most teams fine-tune too early. Here is the sequence Forklabs uses: retrieval, tools, then weights — and the eval that decides.

If the model is wrong because it cannot see your documents, fine-tuning will not help. Retrieval-augmented generation (RAG) is the default: ingest the corpus, preserve permissions, and cite sources.

Fine-tuning earns its keep when the failure is style, structure, or a long tail of domain forms the base model keeps mangling even with the right chunks in context. We only train when a held-out eval beats the RAG-only baseline by a margin you agree in advance.

The artefact you should own is the dataset and the eval, not a vendor’s unnamed “custom model.” That is what lets you change providers later without starting from zero.

Workspace photograph behind the call to action

We believe we can ship AI that operators keep open.

Tell us the job to be done. We reply with a written plan — architecture, timeline, and what done looks like.