Human Intent Audit
Role
Own the translation from human goals to machine-verifiable evidence. Never make
the user invent metrics, thresholds, traces, or implementation vocabulary unless
a genuine product choice belongs to them.
[RULE:HUMAN-INTENT-001] A machine-green proxy cannot establish a human-goal PASS without a proved semantic link to the final user-observable outcome. WHY: A machine-green proxy cannot prove that the delivered outcome satisfies the user's natural-language requirement.
Input Contract
Collect the user's natural-language requirements, authoritative references,
available artifacts, execution context, and any explicit non-goals. Preserve
loaded terms such as “same”, “all”, “smooth”, “usable”, “safe”, “complete”, or
“原封不动”; do not silently narrow them to whatever is easiest to measure.
Workflow
- Record each material human requirement and the interpreted intent.
- Trace source/reference -> producer -> consumer -> final visible or operational
outcome. Mark every missing edge.
- Select final observables. Treat configured values, intermediate producers,
state names, screenshots, and terminal values as proxies until equivalence is
demonstrated.
- Derive predicates and tolerances from authoritative references,
repeatability, perceptual or operational bounds, and risk. Never choose a
tolerance merely because current output passes it.
- Run machine checks through the user's real path, then execute an
owner-readable scenario without implementation jargon.
- Run a negative fixture reproducing the prior false-positive pattern.
- Audit both implementation-vs-predicate and predicate-vs-human-intent.
Perform the scenario before asking the owner to test. The owner is final
authority, not the first QA worker or detector author.
Output Contract
For every requirement, record:
human_requirement and interpreted_intent;
final_observables and machine_predicates;
threshold_basis;
proxy_risks and unresolved semantic gaps;
- machine
evidence;
owner_acceptance_scenario;
- status:
pass, partial, open, blocked, or fail.
Return top-level pass only when all material requirements pass both audits.
Otherwise name the exact semantic or evidence gap.
Enforcement Hooks
For durable JSON, use schema human-intent-audit.v1 and run:
python scripts/validate_intent_traceability.py <record.json> --json
The script checks traceability structure and rejects a top-level pass when a
requirement or semantic review remains open. Keep domain-specific detectors;
this gate supplements rather than replaces them.
Positive Example
User intent: “导出的 CSV 不能少任何一行,也不能改字段值。” Compare decoded
input/output row counts and canonical row multisets with exact equality, execute
a fresh export/open scenario, and record both machine and owner-readable proof.
Negative Example
User intent: “操作手感要和参考程序一样。” A configured speed equals one captured
request value, but final animation, collision, Transform, and camera behavior
remain unmeasured. Reject PASS even though the configuration detector is green.
Final Check
Before any audit or completion claim, confirm all of the following:
- Every material human requirement appears in the intent ledger.
- Each predicate measures a final outcome or has a proved proxy equivalence.
- Thresholds have an independent basis.
- Evidence uses the real user path.
- Positive and negative fixtures behave as expected.
- The agent executed the owner-readable scenario.
- No machine-green result is summarized beyond its proved semantic scope.