Production Agent Runbooks Need Maintenance After Launch

The easiest thing to neglect in a production Agent is not the code. It is the runbook. At launch, the owner remembers the source, the Schedule, which Trust Mode actions stop, and which artifact version was accepted. Weeks later, a new reviewer follows an old note and finds different fields, changed permissions, and a downstream workflow that no longer matches the page. The team returns to manual investigation, repetitive questions, and time-consuming explanation. An Agent runbook maintenance rule keeps the operating note alive.
OpenAI Agents tracing shows the value of run state and step visibility. The OWASP Top 10 for Large Language Model Applications also points teams toward application-level risk. Axon's operating view is that a runbook is not a one-time document. It is part of making a production Agent handoff-ready.
This article connects to Agent workflow catalog hygiene, Agent source access expiry check, Agent permission change record, and scheduled Agent failure policy. Runbook maintenance is not documentation polish. It reduces guessing during the next run.
What Must Stay Current
An Agent runbook maintenance rule does not need every design detail. It needs the fields that affect operation.
| Field | Why it matters | Update when |
|---|---|---|
| source boundary | Defines what the Agent reads and does not read | Source field, folder, or owner changes |
| Schedule | Defines when people receive the artifact | Time, frequency, or freeze window changes |
| Trust Mode | Defines which actions can continue | External send, overwrite, delete, or authorization changes |
| accepted artifact | Defines what reviewers inspect | Template or acceptance criteria changes |
| owner path | Defines who handles issues | Owner, backup owner, or reviewer changes |
These fields matter more than a long background essay. A stale runbook usually means one of them was not updated.
A Lightweight Runbook Entry
Agent: weekly renewal summary
source_boundary: CRM renewal export, refreshed before Monday 08:30
schedule: Monday 09:00, no run during freeze window
trust_mode: no external send, confirmation required for shared artifact
accepted_artifact: v2 renewal summary template
owner_path: Agent owner -> backup owner -> reviewer
last_reviewed: 2026-07-05
This entry is short enough to maintain. It tells the next person how the current production version runs, not the entire history of the Agent.
Signs The Runbook Is Stale
A stale runbook usually shows up through practical friction:
- The operator cannot find the source named in the note.
- The reviewer sees an artifact shape that the note does not mention.
- The Schedule changed but the runbook still shows the old time.
- Trust Mode behavior does not match the note.
- The owner is absent and no backup owner is visible.
The danger of a stale runbook is that the team starts using memory instead of reviewable operating evidence.
When these signals appear, update the field directly and record who confirmed it.
Four Update Triggers
Step 1: when source changes, update source boundary and stale signal.
Step 2: when release or rollback happens, update accepted artifact and current version.
Step 3: when permission or Trust Mode changes, update action boundary.
Step 4: when owner, reviewer, or backup owner changes, update the handoff path.
Those triggers cover most production Agents and keep the runbook from becoming an abandoned manual.
Treat the rule as a maintenance habit, not a documentation project. The owner should update the exact field that changed, keep the previous value only when it helps audit the transition, and add a last-reviewed date. Long background sections can stay elsewhere. The runbook earns its place when a backup owner can open it during a missed run, source delay, or reviewer question and know the current operating truth without asking three people.
The maintenance rule also protects change quality. If a release changes the artifact but the accepted artifact section is not updated, the release is not complete. If a permission change alters Trust Mode but the runbook still describes the old confirmation path, the Agent is harder to govern. Axon should make these mismatches visible before the next production run, while the context is still fresh.
FAQ
Q1: Does every Agent need an Agent runbook maintenance rule?
Production and team-shared Agents do. Personal experiments can use lighter notes.
Q2: Should the runbook be detailed?
Only where detail affects operation. Keep source boundary, Schedule, Trust Mode, accepted artifact, and owner path accurate first.
Q3: Who maintains it?
Usually the Agent owner. Reviewers and operators can propose corrections, but the owner confirms production facts.
Q4: How often should it be reviewed?
Monthly for stable Agents. Immediately when source, permission, Schedule, artifact, or owner changes.
Q5: Where should it live?
In an Axon Agent note, Workflow catalog entry, or workspace artifact near accepted artifacts and run evidence.
Next Step
Start using Axon for production Agents by writing one Agent runbook maintenance rule for each important Agent: source boundary, Schedule, Trust Mode, accepted artifact, owner path, and last reviewed. Learn more by asking whether the operating note is still trustworthy, not only whether the Agent still runs.