Payeshwatching the work

Conductor

The orchestrator and harness behind every figure on this site.

Conductor is an orchestrator I built and still run: a program that takes a plan written before anything starts — stages, checkpoints, gates, limits — and drives a coding agent through it, session by session, unattended. It spawns each session, watches it, stops it at its limits, checks the work with commands rather than questions, and writes what happened into a store the run cannot edit.

This is the technical half of the site. The concepts and the articles read fine without it; this page is for the reader who wants the machine itself — what it is made of, how a run is declared, and where each concept of agent-driven engineering lands in the mechanism. The record it produced is at the foot: the corpus in numbers, what the record showed, and the runs in depth — every figure recomputed from the store, as everywhere else here.

The engine is public: github.com/shaahink/conductor.

The shape of the machine

Half the vocabulary makes sense the moment you can see where a word sits: the loop that is an agent, and the run wrapped around it. Every word in a box is defined in the glossary.

orchestrator · conductor — plan · limits · gates · record

The agent is the small loop. The orchestrator is the ring around it: it starts sessions, stops them at their limits, runs the gates, and writes down what happened.
A run is the whole journey, across as many sessions as it takes. The plan is written first and enforced rather than re-decided; the record is what is left when the machine stops.

Every word in a box is defined, in reading order, in the glossary.

The concepts, mapped onto the machine

Each concept page states its idea so it is useful anywhere, and only then shows the mechanism. This is the same join read from the other end — one row per concept, the mechanism in one breath, the full page a link away.

  1. Agentic engineering

    The session cycle, mechanised: pick the next open checkpoint, build the prompt, spawn a session, watch it, verify what it claims, write the record, repeat until the stage closes. The engineering lives in that ring, not inside the model.

  2. Multi-agent orchestration

    Not a fleet of equals. One capable agent does the work through distinct session kinds — deliver, fix, resume, audit, verify, review — while a cheap advisor lane on a smaller model reads the run and comments, with its own line in the ledger.

  3. Context engineering

    Prompt templates with a declared read order and handoff blocks between sessions. Every rendered prompt is written to the run's logs, and an unresolved token in a template throws and parks the run rather than shipping a half-built prompt.

  4. Token economics and context budgets

    A ceiling on what one session may spend, cache reads included; a cooperative wrap-up nudge below it; rollover when the ceiling lands mid-turn. The engine's budget verb places the nudge from the ledger's own medians instead of by feel.

  5. Evals, gates and acceptance

    A battery of real commands with real exit codes, tiered per stage, cached per commit, retried once unconditionally. Nobody asks the agent whether the tests pass; the battery is the answer.

  6. Independent verification

    The verifier is a separate program. A tracker claim is not a confirmation, done is not done-and-confirmed, and an agent cannot flip a red build green from inside its own session — the phase gate is the only path that closes a stage.

  7. Durable execution and resumability

    An event-sourced store under everything: sessions are boundaries, a run resumes across a process restart, the plan can be swapped mid-run, and a rollover consumes no attempt. The record survives the machine that made it.

  8. Human in the loop

    Stages a person has to close: owner gates, a blocked-until queue, and push-only notification. The run parks where a decision is genuinely the owner's, and the approval is recorded as an event like everything else.

  9. Agent observability

    One event spine, and verbs over it — history, money, budget, journey — plus the terminal Face. The harvest behind this site reads the same store, which is how the loop you are looking at closes.

  10. Agent memory

    A knowledge ledger and lessons that outlive the session that learned them, and a run-scoped bug ledger — carrying the honest trap that an era's open bugs vanish when the next plan starts.

What a run is made of

A run is declared, not improvised: one plan file, one tracker a person can read, and the store the engine writes. The plan that built the page you are reading is committed in this repository — these are its moving parts.

The plan
Stages and their checkpoints, written before anything runs, with dependencies between stages and an owner gate on the one that ships. The engine never re-plans; it enforces what is written.
The agent line
The command a session actually runs — here a coding agent CLI, with the model named per run and a separate resume path for a session that comes back. The engine does not care which agent, only that a prompt goes in and a stream of events comes out.
The advisor lane
A second, cheaper model that reads the run and comments rather than doing the work. Its cost is a separate category in the ledger, which is how the record can say what the second opinion cost.
The gates
Per-stage batteries of real commands with tiers and timeouts: a fast battery on every delivery, the full one before a stage closes. This site's own battery typechecks and builds, diffs the generated files clean, and recomputes every published figure from the run store.
The workflow
Which sessions a checkpoint takes. This repository delivers, then pays for a fix session only when the battery actually came back red — rather than a paid re-audit after every delivery.
The limits
The ceilings and the patience: a token ceiling per session with the cooperative wrap-up under it, stall detection with backoff, a resume budget per session, and a cost cap on the whole run. The ceilings here were placed by the engine's own budget verb, not by feel.
The tracker and the store
A markdown board a person can read beside an event-sourced store the engine owns. The claim lives on the board; the confirmation lives in the store; this site's harvest reads the store and nothing else.

The bundle that built this page is committed in this site's own public repository: the plan and the tracker the engine kept.

Evidence

20 runs across 7 repositories

387
sessions
340/356
checkpoints closed
$3,487.85
spent across the corpus
6d 17h
of engine timeevery session's duration added up, across all 20 runs; runs that overlapped are counted in both
38d 20h
from the first session to the lastthe calendar the whole corpus happened in, not the time anything was working

Recomputed from conductor history --json --limit 0 and run.db, opened read-only. Nothing on this page is typed in.

What the record shows

Six things a month of this turned up that I had not expected, each one measured rather than felt, and each linked to the page where it is worked out properly.

  1. 98.3%of the corpus's tokens were cache reads

    of every token the corpus moved was a cache read, not a fresh one. The bill for an agent is mostly the cost of it re-reading what it already knew, which is why session length dominates every other variable.

    ArticleWhat an autonomous run actually costs

  2. 50/50of the killed sessions had already been nudged

    of the sessions killed at a token ceiling had already been asked to wrap up, in time, and carried on anyway. The cooperative rail converted none of them — delivery is not conversion, and nobody was measuring the difference.

    ArticleThe nudge that sat below the median

  3. 0/53rolled-over sessions recorded a commit

    rolled-over sessions recorded a commit, and the column holds a zero rather than nothing at all — so it reads as a measurement instead of a gap. A population whose history was never written looks identical to one that did nothing.

    ArticleThe ledger that lied

  4. 4of the red gates never ran at all

    of the red gates never ran at all: an exit status the command did not choose, dying on the way up in tens of milliseconds. An agent reporting that its tests pass would have sailed straight past every one of them.

    ArticleNever believe the agent

  5. 340/356checkpoints closed

    checkpoints closed across the corpus. The most useful run here is the one that stopped one short, because the store recorded exactly why the last one stayed open.

    Run reportThe long build

  6. $0.26on the advisor lane

    went on the advisor lane, against three thousand on the agent doing the work. An orchestrator is not many expensive models in a trench coat; it is one expensive model and a great deal of arithmetic.

    ConceptMulti-agent orchestration

Three runs in depth

Published as the shape of the work rather than as whose work it was, so you can map your own situation onto one. The dates and durations are the sessions' own.

They are three out of eighteen, and the other fifteen are on the runs page with the same figures beside them — including the false starts and the prototype that was abandoned where it stood. A corpus that shows only the runs worth writing up is a portfolio.

All the runs, with their figures

Where this goes next

The corpus is one month, and it is still growing. The engine that produced it is mid-life: the era after this one is already written down — several repositories under one plan, analysis running in lanes beside the main session, and the board pushed to GitHub so a run can be watched from a phone without the machine opening a single inbound port.

None of that is measured yet, which is why it lives on its own page, labelled as intent — the one page here with no figures on it. Runs join the corpus as they finish.

The roadmap, with what each item waits on