Compare evaluated runs in a retort experiment along factor dimensions. Surfaces effects of each factor, aggregates across replicates, and highlights cells that diverge qualitatively — complementing (not replacing) retort's ANOVA analysis.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新
Determine the TRUE cause of a failed retort run before attributing it. Ground-truth every failure (run its tests, read its agent logs, inspect its workspace) and classify it as an infrastructure false-fail, a genuine model miss, or an environment issue — never trust the gate verdict or a log signature alone. Use whenever a run is recorded failed (test_coverage=0 / gate fail), a pass rate looks low, or you're deciding whether a "failure" is real before reporting or proceeding.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新
Evaluate a single retort experiment run. Score the generated code against the task's TASK.md requirements, run its build and tests, compute metrics, and emit a structured evaluation report plus a machine-readable findings file.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新
Aggregate a retort run's findings.jsonl into a machine-readable assessment.json summary with severity counts, penalty score, requirement coverage, and top findings.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新
Summarize the architecture of code generated by a single retort run. Produces module-level structure, interfaces, and control flow in a form suitable for cross-run comparison — not a full codebase-summary.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新
Refresh the data tables in optimal-blog.md from master.db. Checks the data for integrity problems FIRST, then runs the generator that picks per-language winners and splices every GEN-marked table, then reconciles the surrounding prose. Use after new experiment results land, or when the optimal-blog numbers are stale.
中文简介正在准备中。当前显示原文说明。
adrianco/retort☆ 2102026年10月18日 更新