본문으로 건너뛰기
cccskills
무료GitHub에 공개

econ-audit

Review economic reports for methodological gaps, unsupported figures, and errors such as double counting. Produce a red, amber, and green scorecard with issues ranked by severity, using the relevant appraisal framework and proposing corrections when requested.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

원문원문 설명 보기

Audit economic analysis outputs (fiscal briefings, macro briefings, market research, longlists, and other quantitative economic documents) against methodology standards, academic literature, and common errors. Runs structured checks across core categories including counterfactual, additionality, discounting, double counting, distributional analysis, Aqua Book RIGOUR, and Flyvbjerg-style strategic misrepresentation detection. Returns a RAG scorecard with issues ranked by severity.

연동 도구ExcelWord

실행 점수 미검증

설치 방법 보기

이럴 때 유용합니다

  • Checking fiscal and macroeconomic briefings before submission
  • Reviewing cost-benefit assumptions and double counting
  • Auditing reports against a selected appraisal framework
  • Creating a prioritized correction plan for economic analysis

포함된 파일(2)

  • SKILL.md19.0 KB
  • SKILL.tmpl13.4 KB

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Only stop to ask the user when: the document type is unrecognised, or fix confirmation is needed under --fix mode. Never stop to ask about: which checks to run (all applicable ones), grading methodology, or output filename.

<!-- preamble: update check -->

Before starting, run this silently. If it outputs UPDATE_AVAILABLE, tell the user: "A new version of econstack is available. Run cd ~/.claude/skills/econstack && git pull to update." Then continue with the skill normally.

~/.claude/skills/econstack/bin/econstack-update-check 2>/dev/null || true
<!-- preamble: project learnings -->

After the update check, run this silently to load prior learnings for this project:

eval "$(~/.claude/skills/econstack/bin/econstack-slug)"
~/.claude/skills/econstack/bin/econstack-learnings-read --limit 3 2>/dev/null || true

If learnings are found, apply them. When a prior learning influences a decision, note: "Prior learning applied: [key]".

Capturing new learnings: After completing this skill, log new insights via:

~/.claude/skills/econstack/bin/econstack-learnings-log '{"skill":"...","type":"...","key":"...","insight":"...","confidence":N,"source":"observed|user-stated|inferred"}'

Types: framework (preferred appraisal framework), parameter (custom overrides), data-source (preferred data), output (past report references), operational (tool/env quirks), preference (formatting/style). Confidence: 9-10 observed/stated, 6-8 strong inference, 4-5 weak. User-stated never decays; observed/inferred lose 1 point per 30 days. All data stored locally. Nothing transmitted.

<!-- preamble: parameter database check -->

After the update check, verify the parameter database is available and check staleness:

PARAMS_DIR="$HOME/econstack-data/parameters"
if [ -d "$PARAMS_DIR" ]; then
  PARAM_COUNT=$(find "$PARAMS_DIR" -name "*.json" 2>/dev/null | wc -l | tr -d ' ')
  echo "PARAMS: $PARAM_COUNT files loaded from $PARAMS_DIR"

  # Check for stale files (last_verified > 2 years ago)
  STALE=$(find "$PARAMS_DIR" -name "*.json" -mtime +730 2>/dev/null | wc -l | tr -d ' ')
  if [ "$STALE" -gt 0 ]; then
    echo "PARAMS_WARNING: $STALE file(s) not updated in 2+ years. Run: cd ~/econstack-data && git pull"
  fi
else
  echo "PARAMS: not found. Using built-in defaults. For full parameter support: git clone https://github.com/charlescoverdale/econstack-data.git ~/econstack-data"
fi

If PARAMS_WARNING appears, tell the user which parameter files may be stale and recommend updating. Continue with the skill normally using whatever parameters are available.

<!-- preamble: safety hooks -->

Safety rules for this skill:

  1. Parameter database is read-only. Never write to, modify, or delete files in ~/econstack-data/parameters/. These are shared, versioned parameters maintained separately. If a parameter needs updating, tell the user to update the econstack-data repo.

  2. Confirm before overwriting. Before writing an output file, check if a file with the same name already exists. If it does, ask the user: "A file named [filename] already exists. Overwrite it, or save with a new name?" Do not silently overwrite.

<!-- preamble: completion status -->

At the end of every skill run, report one of these statuses:

  • DONE: Analysis complete, output generated, all sections finished.
  • DONE_WITH_CONCERNS: Output generated but with caveats (e.g., data gaps, assumptions that need review, sections below expected depth).
  • BLOCKED: Cannot proceed (e.g., missing critical input, parameter database unavailable, framework not supported).
  • NEEDS_CONTEXT: Need more information from the user before continuing.

Format: STATUS: [status] | [one-line reason]

/econ-audit: Economic Analysis Audit

Reviews any economic analysis output against methodology standards and practitioner best practice. Works on fiscal briefings, macro briefings, market research reports, longlists, or any document making economic claims with numbers.

Think of it as a senior partner and an economics professor going through your work and poking holes in it. Returns a RAG (red / amber / green) scorecard with issues ranked by severity, plus an optional --fix mode that proposes concrete corrections.

Arguments

/econ-audit [file or directory] [options]

Examples:

/econ-audit longlist-schools-2026-04-10.md
/econ-audit fiscal-uk-2026-04-10.md --strict
/econ-audit . --fix
/econ-audit macro-uk-2026-04-10.md --framework uk-gb

Options:

  • --strict : Apply higher bars. Green requires all checks pass cleanly; amber becomes red if material.
  • --fix : After scoring, propose concrete corrections for each issue. Optionally apply them (prompted per-issue).
  • --framework <name> : Override the auto-detected framework (uk-gb, eu-brg, wb, adb, au-vic).
  • --section <name> : Emit only one sub-component. Options: full (default), headline (letter grade and count only), issues (issue list only), methodology, fix-plan (if --fix was used). Combinable.
  • --format <type> : Output format(s). markdown (default, always generated), xlsx, word, or pdf.
  • --client "Name" : Add "Prepared for" metadata.

Check categories

The audit runs structured checks across these categories. Checks are framework-aware: some checks apply only to specific frameworks.

CategoryChecksApplies to
CounterfactualIs Do Nothing specified? Is it dynamic (not static)? Are all benefits incremental to it?All
AdditionalityDeadweight, displacement, leakage applied? Rates defensible? Not applied to carbon?All
DiscountingFramework-appropriate rate? Declining vs flat correct? Health at 1.5% if applicable?All
Optimism biasApplied at the right rate for project type and stage?uk-gb only
Double countingConstruction jobs + capex? Journey time + land value? Gross earnings + tax?All
TransfersTax receipts, welfare payments correctly excluded from social CBA?All
Sunk costsPrior spend excluded?All
Cash vs non-cashEconomic NPV includes all; Financial NPV includes only cash in / cash out?All
Five Case consistencyFinancial vs Economic capex, benefits register vs realisation, risk register vs contingency, preferred option consistentuk-gb, au-vic business cases
DistributionalIs distributional incidence reported? Is it explicit for uk-gb if material, and mandatory for wb, adb, au-vic?Framework-dependent
Aqua Book RIGOURRepeatable, Independent, Grounded, Objective, Uncertainty-managed, Robustuk-gb
Flyvbjerg indicatorsScope near thresholds, low contingency, optimistic demand, benefit / cost asymmetryAll
Data vintagesAll cited numbers have a vintage within a reasonable windowAll
Source qualitySources cited, from official or peer-reviewed originsAll

Instructions

Step 1: Identify the document

If the user passes a single file path, load that file. If they pass a directory, glob for markdown files and audit each one in turn.

Auto-detect the document type from the file name or the KEY NUMBERS block at the top:

  • longlist-*.md, type: longlist → Longlist
  • macro-*.md, type: macro-briefing → Macro briefing
  • fiscal-*.md, type: fiscal-briefing → Fiscal briefing
  • market-*.md, type: market-research → Market research
  • briefing-*.md, type: briefing-note → Briefing note
  • Unknown → ask the user what it is once.

Auto-detect the framework from the document header or KEY NUMBERS. Default to uk-gb if missing.

Step 2: Run all applicable checks (silent)

For each check in the category table above, evaluate:

  • Pass (green): the check is met or clearly met.
  • Warn (amber): the check is partially met or cannot be determined from the document.
  • Fail (red): the check is clearly violated or entirely absent when it should be present.

Checks are framework-aware. Do not apply optimism bias checks to a non-uk-gb document. Do not apply Aqua Book RIGOUR to a non-uk-gb document. Do apply Five Case consistency to uk-gb and au-vic business cases, and skip for other document types.

Step 3: Score and rank

Compute:

  • Count of passes, warnings, fails
  • Overall letter grade: A (no fails, few warnings), B (few fails, some warnings), C (several fails, many warnings), D (serious methodology gaps), F (unusable)
  • Under --strict: amber escalates to red for material issues.

Rank issues by severity:

  • Critical: methodology gap that invalidates the conclusion (missing counterfactual, wrong discount rate, material double counting, transfers included in social NPV).
  • High: material gap that weakens the conclusion but does not invalidate it.
  • Medium: presentation or evidence gap that should be addressed before submission.
  • Low: stylistic or completeness nit.

Step 4: Fix plan (if --fix)

For each critical and high issue, propose a concrete fix. Example fixes:

  • "Add a dynamic counterfactual describing deterioration of existing assets over the appraisal period."
  • "Apply 24% optimism bias uplift to capital costs per HMT Table 1 for this project type and stage."
  • "Remove council tax receipts from the benefits table; note in a separate fiscal annex."
  • "Compute additionality using 20% deadweight, 25% displacement, 10% leakage; current analysis uses unadjusted gross benefits."

Under --fix, for each proposed fix, ask the user to confirm application. If confirmed, edit the source document in place. If not, record in the fix plan and move on.

Step 5: Write the output

Save audit-[target-slug]-[YYYY-MM-DD].md with this structure.

<!-- KEY NUMBERS
type: econ-audit
target: [target file or directory]
framework: [framework]
strict: [true|false]
passes: [count]
warnings: [count]
fails: [count]
grade: [A|B|C|D|F]
critical_issues: [count]
high_issues: [count]
fixes_applied: [count]
date: [YYYY-MM-DD]
-->

# Audit: [target file name]

**Date**: [YYYY-MM-DD] · **Framework**: [framework] · **Strict mode**: [on/off]

## Headline

**Grade**: **[A / B / C / D / F]**
**Checks**: [passes] pass, [warnings] warn, [fails] fail
**Critical issues**: [count]

[One-sentence summary: e.g. "Grade B. The CBA is sound in structure but applies additionality inconsistently and is missing a distributional analysis."]

## Scorecard

| Category | Result | Notes |
|----------|:------:|-------|
| Counterfactual | [G/A/R] | [one line] |
| Additionality | [G/A/R] | [one line] |
| Discounting | [G/A/R] | [one line] |
| Optimism bias (if uk-gb) | [G/A/R] | [one line] |
| Double counting | [G/A/R] | [one line] |
| Transfers | [G/A/R] | [one line] |
| Sunk costs | [G/A/R] | [one line] |
| Cash vs non-cash | [G/A/R] | [one line] |
| Five Case consistency (if applicable) | [G/A/R] | [one line] |
| Distributional | [G/A/R] | [one line] |
| Aqua Book RIGOUR (if uk-gb) | [G/A/R] | [one line] |
| Flyvbjerg indicators | [G/A/R] | [one line] |
| Data vintages | [G/A/R] | [one line] |
| Source quality | [G/A/R] | [one line] |

## Issues (ranked by severity)

### Critical

- **[Issue 1]**: [description] · Location: [section / line] · Fix: [suggested fix]
- **[Issue 2]**: [description] · Location: [section / line] · Fix: [suggested fix]

### High

- **[Issue 3]**: [description] · Fix: [suggested fix]

### Medium

- **[Issue 4]**: [description]

### Low

- [Issue 5]

## Methodology notes

[One paragraph: which framework was applied, which checks were skipped and why, any caveats on the audit itself.]

[If --fix]
## Fix plan

[List of proposed fixes with confirmation status: Applied / Rejected / Pending.]

Sub-component selection (via --section): emit only the requested parts.

  • full (default): the whole structure above.
  • headline: grade and count only.
  • issues: issue list only.
  • methodology: methodology notes only.
  • fix-plan: fix plan only (requires --fix).
  • Combinable: --section headline,issues.

Format-specific output structure (only produce formats explicitly requested; see dispatcher below):

  • Markdown (.md): audit-[target-slug]-[date].md with the structure shown above.
  • Excel (.xlsx): one workbook with sheets: Scorecard, Issues, Fix plan. Conditional formatting on the Result column.
  • Word (.docx): one document, full audit.
  • PDF: render markdown through econstack Quarto template.

Output formats

The user requests format(s) via --format. Default: md. Comma-separated lists are allowed (e.g. --format md,pdf); all expands to every supported format.

For each format explicitly requested, produce that file and only that file:

  • md: write the markdown inline (only when md is in the requested set).
  • docx: invoke the docx skill with the rendered content.
  • pdf: render via the econstack Quarto template (or invoke the pdf skill if no template exists for this skill).
  • xlsx: invoke the xlsx skill with the structured tables.
  • pptx: invoke the pptx skill with the briefing as a deck.

Do NOT produce formats that were not requested. This is the v0.4 fix for the multi-format leak that previously caused --format pdf to also write .md and .docx files alongside the PDF. Any intermediate files needed during rendering must go to a temp directory and be cleaned up before the skill returns.

When you finish, the file listing in your "Saved:" message must contain exactly the files the user asked for, no extras.

Tell the user (listing only files produced):

Audit complete. Grade [X]. [N] critical, [M] high, [K] medium issues.

Saved:
  audit-[target-slug]-[date].md
  [other formats if requested]

Citation discipline

Every numerical claim in the output must be followed by an inline citation in the form [SOURCE_CODE, vintage]. SOURCE_CODE is a short tag (e.g. ONS_PSF, OBR_EFO, BoE_MPR, Fed_FOMC, ECB_EB, RBA_SoMP, IMF_WEO, OECD_EO, Eurostat, BLS, BEA, FRED, ABS, Comtrade) matching an entry in the References footer. vintage is the publication date of the source data (e.g. Mar 2026, Q4 2025, Jan 2026).

Examples:

CPI was 3.4% YoY in March 2026 [ONS_CPI, Mar 2026].

The OBR forecasts borrowing falling to 1.6% of GDP by 2028-29 [OBR_EFO, Mar 2026].

Industry concentration is moderate: HHI is 1,820 across the top 8 firms [Companies_House, Q4 2025].

Numbers that cannot be sourced to a primary publication must NOT appear in the output. No exceptions: do not estimate, infer from training data, interpolate, or recall from memory. If a needed number isn't in fetched data, state it explicitly:

[Source] has not yet published this measure for [period].

Self-check before output: scan the draft for every number. If any number lacks an inline citation, either add the citation or remove the number. Citation density should be roughly even across sections; a section with no citations is a red flag that the section was generated rather than sourced.

Factuality

Audit findings carry weight only if they cite the framework rule being audited against. Every issue in the Issues table needs a citation to the canonical source: Green Book paragraph or annex, Magenta Book chapter, Aqua Book principle, EU Better Regulation toolbox tool number, World Bank OP, ADB project guidelines, AU Treasury CBA guide, Victorian HVHR Investment Lifecycle Guide. Do not paraphrase or invent rules.

Common gotchas: STPR is 3.5% (Green Book Annex 6) with a declining schedule, NOT a flat 3.5% across all horizons; optimism bias rates depend on project type AND stage (Outline vs Final Business Case); ADB EIRR hurdle is 9% (general) or 6% (climate, health, education); HMT shadow carbon comes from DESNZ, not Treasury directly.

Out of scope (unless explicitly requested)

An audit is a methodology check, not a redo of the analysis:

  • Do NOT re-compute NPV / BCR / EIRR yourself unless the user asks.
  • Do NOT propose alternative parameter values; flag the issue and reference the canonical source.
  • Do NOT make a positive recommendation about whether the option should proceed.
  • Do NOT extend beyond the framework the audit is targeting (the --framework flag bounds the audit scope).
  • Where issues cross framework boundaries, surface them as a "framework choice" finding rather than auditing against a framework the user did not select.

Framework-specific checks

uk-gb

  • Optimism bias at Table 1 rates per project type and stage.
  • Distributional weights applied if benefits materially affect low-income groups (Annex 4).
  • Aqua Book RIGOUR: Repeatable, Independent, Grounded, Objective, Uncertainty-managed, Robust.
  • Green Book 2026 updates: BCR misuse, health discount rate (1.5%), carbon pre-discounting, wellbeing valuation.

eu-brg

  • SME test applied if business-affecting.
  • Fundamental rights screening performed.
  • Proportionality and subsidiarity addressed.
  • REFIT alignment stated for amendments to existing legislation.

wb

  • Distributional incidence by income decile.
  • Poverty headcount impact reported.
  • Shadow wages applied consistently for labour benefits.
  • OP 10.04 structure followed.

adb

  • 9% EIRR hurdle (or 6% for climate / health / education).
  • Switching values mandatory on all major variables.
  • Poverty and gender disaggregation reported.
  • Climate Typology tagging if climate co-benefits claimed.

au-vic

  • Investment Logic Map present, with problem-benefit traceability.
  • Benefit Management Plan has owner, KPI, baseline, target, timeframe for every benefit.
  • Disbenefits captured explicitly.
  • P50 / P90 risk allowance applied.

Important rules

  • Framework-aware. Do not apply uk-gb checks to an eu-brg or wb document. Only run checks applicable to the detected framework.
  • Honest about limits. Some checks cannot be fully verified from a written document alone (e.g. whether the counterfactual is truly dynamic). Use warn (amber) in those cases, not pass.
  • Severity drives grading. A single critical issue caps the grade at C regardless of how clean the other checks are.
  • Fix plans are concrete. Do not propose vague "improve the counterfactual" fixes. Specify what to add and where.
  • Do not rewrite the document unilaterally. Under --fix, always confirm each edit with the user before applying.
  • Em dashes: never use em dashes. Use commas, colons, parentheses, or "and".

Integration with other skills

  • Audits outputs from /longlist, /macro-briefing, /fiscal-briefing, /market-research, and /briefing-note.
  • Can be run automatically via the --audit flag on most econstack skills (they invoke /econ-audit on their own output after generation).

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

a1

무료

Turn a broad research idea into clear, testable questions. Compare familiar and less conventional approaches, structure the selected question around its population and methods, and assess variables, feasibility, and potential theoretical contributions.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Turn a research topic into testable questions
  • Narrow an overly broad research question
  • Compare alternative research angles
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

a2

무료

Helps build a research framework by comparing theories, mapping relationships between variables, and deriving testable hypotheses. Explores less conventional options, examines weaknesses and competing explanations, and produces diagrams with anticipated reviewer objections.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Comparing theories for a research question
  • Deriving hypotheses from relationships between variables
  • Examining weaknesses and anticipated reviewer objections
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

a5

무료

Clarify the philosophical assumptions behind a research project and check whether they fit the proposed methods. Get a reasoned research stance, draft proposal wording, and guidance for explaining how the researcher's background and values shape the study.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Clarifying philosophical foundations for a research proposal
  • Explaining why the chosen research methods fit the study
  • Drafting a statement about the researcher's position
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

Plan and draft academic papers through specialized agent roles covering literature, arguments, citations, and review. Get chapter guidance, revision roadmaps, Traditional Chinese and English abstracts, and documents formatted as LaTeX, DOCX, PDF, or Markdown.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Planning a paper chapter by chapter
  • Drafting a paper from research materials
  • Turning reviewer comments into a revision roadmap
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

Turn a detailed outline into a philosophy or interdisciplinary manuscript. Draft chapters with repeated quality reviews, check terminology and arguments across sections, and prepare the manuscript, evaluation reports, abstract, and metadata for submission.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Draft a full paper from a detailed outline
  • Review argument and citation quality chapter by chapter
  • Check terminology and argument flow across chapters
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

Simulate academic peer review through five reviewer roles tailored to the paper's field. Receive separate critiques, an editorial decision, and a prioritized revision roadmap, or check whether a revised manuscript addresses earlier comments.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Review a manuscript before journal submission
  • Examine research methods and statistical validity
  • Challenge core arguments and alternative explanations
brycewang-stanford/Auto-Empirical-Research-Skills4.7천2026년 10월 20일 업데이트

brycewang-stanford의 스킬 모두 보기

이 스킬의 문제 신고