Human-in-the-loop AI for a small agency: where the person goes

TL;DR — A five-person agency can use AI for research, first drafts and rewrites without clients noticing, provided a named person owns three moments: the brief, the read-through and the send. Automate the middle, never the edges. Below is the setup that has worked for agencies our size, what it costs in time, and where it breaks.

What does “human in the loop” mean for an agency?

It means a person makes every decision a client would ask about. Not every keystroke, every decision. Which topic, which angle, which claim stays in, whether it goes out. The model does the parts nobody asks about: reading forty forum threads, producing the first structure, turning an outline into prose, checking that a number matches its source.

The distinction matters because clients do not object to tools. They object to being surprised. An article that a person chose, read and signed off on is defensible in any meeting. One that a scheduler pushed out at midnight is not.

Where should the person sit in the process?

Three places, and they are cheap.

• The brief. One sentence of intent plus three answers: angle, reader, stance. Two minutes. This is where taste lives, and it is the part clients pay you for.
• The read-through. Read the draft once, top to bottom, as the client would. Cut what is wrong, tighten what is loose. Ten to fifteen minutes for a 1,200-word piece.
• The send. A person presses publish, or hands it to the client. Thirty seconds, and it is the difference between a process and a leak.

Everything between those points can run on its own. Everything at those points should not.

What can safely be automated?

Research collection, as long as every fact carries a source you can click. Outlines, as long as they link to pages that exist. First drafts. Fact-checking against the research. The prose pass that removes model habits. Structural validation: headings, links, length. None of these require judgement about the client; they require consistency, which is what machines are for.

What cannot be automated safely: choosing the topic, taking a position, anything that names a competitor, and anything with a number the client will be quoted on. Those go through a person every time.

How much time does it actually save?

For a typical 1,200-word article an agency writer spends about four to six hours end to end: an hour of reading, an hour of outline, two to three of drafting, one of edits. With the middle automated, the person spends the two minutes on the brief, fifteen on the read, and perhaps twenty on edits when the draft needs them. Call it forty minutes. The saving is real, but the quality depends entirely on the fifteen minutes of reading being done properly. Skip them and you are back to publishing whatever came out.

Will clients notice?

They notice three things: invented facts, a change in voice, and generic phrasing. The first is solved by a fact-check stage that deletes what it cannot source. The second by writing from a tone file built from the client’s own site rather than from a generic style. The third by a dedicated editing pass and, again, by a person reading. When those are in place, what clients notice is that turnaround got faster.

Tell them anyway. An agency that explains its process before the client asks keeps the client. One that gets asked first does not.

Where does this break?

Regulated industries, where every claim needs review by someone with a licence. Very technical niches, where the model’s research will be shallow and the person’s read-through becomes a full rewrite. And any team that treats the read-through as optional under deadline pressure. The process only works if the fifteen minutes are non-negotiable.

FAQ

Do we need to tell clients we use AI? Not legally in most places, but do it anyway. Explaining the three human checkpoints is a stronger pitch than pretending.

Which person should do the read-through? Whoever would have written it. The person with the client context, not the most junior one.

Can a client see the stages? Yes. Share the stage log with the draft. Most clients find it reassuring.

Sources

• Internal time tracking across three small agencies, 2025, unpublished.
• Google Search Central, guidance on AI-generated content (search-central documentation).
• Reprieve philosophy: a human stays in the loop