A practical guide

Teach a specialist a single job

Gather examples, train, test, and pick where it runs.

All guides

“Send me your categories and some examples you’ve checked. I’ll show you what I learned before you rely on it.”

Otis
1

Define a narrow task

Describe the input, the output you expect, and the cases that matter. Classifying requests or pulling structured fields out of them is a better place to start than a broad goal like “understand the business.”

2

Choose the data and processing route

Only use examples you have permission to use. Settle on the approved training backend, the model license, hardware, budget, and destination. Then ask an Agent with the training capability to organize the workflow.

3

Prepare and review the examples

Agents can help gather examples and check their quality. Resolve any disagreements, or set those examples aside. Hold back a test set that won’t be used to train the candidate.

4

Train and compare

Run a supported training job and compare the candidate with the baseline on the held-out work. Look at the kinds of mistakes it makes as well as the overall result.

5

Make the accepted model available

Deploy it to the approved hosting route and choose which Agents or tasks can use it. Letting an Agent consult the specialist is a different decision from changing that Agent’s main model.

6

Keep an eye on results

Keep the accepted version linked to the examples and evaluation behind it. Watch how it does on the task it was built for, and roll back if an earlier version turns out to be the better choice.

Training is in private preview, on eligible Apple silicon and Linux backends and on separately configured service backends.

Make a start

Start with one Agent and one real job

Set up a workspace, give an Agent something useful to do, and see how far it gets.