Skip to main content
reopt Handbook
reopt Handbook
Harness Engineering

Problem and Structure

Foundations of Harness EngineeringRepo-Readable SystemsThe Five Elements of a HarnessEngineering Mechanics

Evaluation and Interpretation

Evaluation Loop DesignExternal Case Comparison

Case Studies

Case: OpenAICase: AnthropicCase: TossCase: gstackCase: revfactory/harness

Domain Playbooks

Domain PlaybooksScenario: Frontend TeamScenario: Platform TeamScenario: Payments and Settlement TeamScenario: AI Product TeamWhy You Eventually Need Your Own Harness

Rollout and Operations

Team Harness Rollout StrategyTeam Harness Design ChecklistOperations: Entropy and Garbage Collection

Appendix

Verification ReportUpdates
Handbook›Harness Engineering›Repo-Readable Systems
한국어English

Repo-Readable Systems

Use AGENTS.md, docs, observability, executable SSOT, MCP, skills, hooks, and plugins as one work environment.

Key takeaways

  • The first ingredient of a harness is the work environment, not the model; the repository and connected tools are the center.
  • OpenAI's view: AGENTS.md is a short table of contents (where to start, what to trust, how to verify), with detail in structured docs/.
  • Toss's view: docs decay unless connected to execution, so rules must become commands, skills, hooks, and workflows.
  • Separate global, domain, and local layers so context is not mixed into one giant file or disconnected.
  • Repo-readable systems now include runtime primitives (MCP, skills, sandbox, hooks, Secure MCP Tunnel, plugins) that teams must govern like docs.

The first ingredient of a harness is not the model. It is the work environment. OpenAI and Toss both point strongly in this direction.

Why the Repository Is the Center

Agents work best inside the information and tools connected to the repository. The goal is not to dump more text into the prompt. The goal is to make the right information easy to find and connected to execution and verification.

OpenAI View: AGENTS Is a TOC, Not an Encyclopedia

The useful pattern is clear:

  • AGENTS.md should be a short entry point.
  • Details should live in docs/ and design documents.
  • The structure should be searchable and navigable by agents.
  • Browser, logs, and metrics should be connected to the work loop.

A good AGENTS.md does not contain every answer. It says where to start, what to trust, and how to verify.

Toss View: Docs Are Not Enough

Toss emphasizes that documents decay unless they are connected to execution. A harness must become workflow, plugin, command, template, or script.

  • Rules that live only in docs drift away from practice.
  • Team routines should exist as commands, skills, hooks, and workflows.
  • The system should reduce what people have to remember.
  • Team productivity rises when good habits become the default path.

Global / Domain / Local Layers

LayerContainsExample
GlobalCompany-wide standardsSecurity policy, code style, required verification
DomainProduct or team rulesPayment invariants, mobile QA, customer data handling
LocalCurrent task contextIssue link, experiment goal, branch strategy

Harnesses fail when these layers are mixed into one giant file or disconnected from each other.

Minimal Repo Structure

AGENTS.md
architecture.md
invariants.md
release-gates.md
runbook.md
review/SKILL.md
qa-browser/SKILL.md
review.md
ship.md
check-links.mjs
check-release-gates.mjs
llms.txt

Load-Bearing Documents

ArtifactRoleFailure when missing
AGENTS.mdEntry point and priority mapHigh search cost and unstable starting points
Architecture docsStructure and ownership boundariesAgent guesses implicit architecture
InvariantsRules that must not be brokenPlausible but dangerous changes increase
Release gatesDone criteria and approval conditionsSelf-evaluation becomes too optimistic
Runbook / updatesOperations and change historyStale rules accumulate

Harness Primitives as Infrastructure

OpenAI Agents SDK and Codex updates show that repo-readable systems are no longer just documentation patterns. They are becoming a standardized agent runtime surface.

PrimitiveRole in the harness
MCPConnect internal systems, SaaS, data sources, browsers, and tools through a consistent surface
SkillsLoad large knowledge bundles only when needed
AGENTS.mdShort project entry point and priority guide
shell / apply_patchExecute commands and file edits in a reviewable way
Sandbox / ManifestMake inputs, outputs, dependencies, and execution boundaries explicit
HooksAutomate prompt checks, validation, logging, and memory creation
Secure MCP TunnelConnect private or on-prem MCP without public internet exposure
PluginsDistribute provider setup, API key connection, troubleshooting, and domain workflows

The practical meaning is that teams must design more than where docs live. They must decide which tools become MCP, which skills load lazily, which work belongs in a sandbox, which hooks enforce validation, and which plugins standardize team setup.

Principles to Borrow

Conclusion

A good harness is less about talking cleverly to the model and more about placing the repository and tools cleverly around the model.

Related docs

Foundations of Harness Engineering

Define harness engineering, its scope, and why system design matters more than prompt wording for long-running agents.

Case: OpenAI

Analyze OpenAI's harness view through repo-readability, observability, sandboxing, runtime surface, and cleanup.

Maintenance Strategy

Agentic Documentation · Keep docs, instructions, Skills, Plugins, MCP Resources, and validation loops from drifting.

Cmd. /hooks

Codex Command Master · Review lifecycle hooks and manage trust or disabled state.

Agentic Documentation

A practical guide to documentation that AI agents can read, execute, verify, and govern.

Foundations of Harness Engineering

Define harness engineering, its scope, and why system design matters more than prompt wording for long-running agents.

The Five Elements of a Harness

Explain the five design axes behind most practical harnesses: environment, roles, criteria, loops, and maintenance.

On this page

Why the Repository Is the CenterOpenAI View: AGENTS Is a TOC, Not an EncyclopediaToss View: Docs Are Not EnoughGlobal / Domain / Local LayersMinimal Repo StructureLoad-Bearing DocumentsHarness Primitives as InfrastructurePrinciples to BorrowConclusion