跳到正文
cccskills
免费在 GitHub 公开

audit-replication

Audit a research replication package with ten checks covering R syntax, file references, output freshness, dependencies, data sources, and documentation. Receive a pass/fail report with specific issues and suggested fixes for preparing the package for submission.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

Validate the replication package for the sewage-house-prices project. Runs 10 checks covering script execution, file integrity, output freshness, dependency verification, data provenance, and README completeness (AEA format). This skill should be used when asked to "audit replication", "check the package", or "verify reproducibility".

实测评分 未实测

查看安装方法

适用场景

  • Check a replication package before submission
  • Find missing inputs and outdated outputs
  • Review dependency and data source documentation
  • Trace manuscript tables and figures to scripts

包含的文件(1)

  • SKILL.md3.9 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Audit Replication Package

Run end-to-end validation of the replication package for the sewage-house-prices project.

Input: $ARGUMENTS — directory containing the replication package (Replication/ by default), or here for the current project root.


Project-Specific Context

Expected Structure

  • Pipeline scripts: scripts/R/01_data_ingestion/ through scripts/R/06_analysis_datasets/
  • Analysis scripts: scripts/R/09_analysis/
  • Utilities: scripts/R/utils/
  • Python: scripts/python/
  • Data: data/raw/, data/processed/, data/final/
  • Output: output/tables/, output/figures/
  • Manuscript: docs/overleaf/
  • R packages: renv.lock

Workflow

Step 1: Locate Package

  • If $ARGUMENTS is a directory path: use it
  • If $ARGUMENTS is here or empty: use Replication/ if it exists, otherwise project root
  • Verify the directory exists and contains scripts

Step 2: Run 10 Verification Checks

Standard Checks (1-4)

  1. Script syntax — All .R files parse without syntax errors
  2. File references — All read_parquet(), readRDS(), read.csv() targets exist or are documented as inputs
  3. File integrity — No orphaned scripts (referenced but missing), no orphaned outputs (generated but unreferenced)
  4. Output freshness — Output files are newer than their source scripts (no stale outputs)

Submission Checks (5-10)

  1. Package inventory — Scripts are logically ordered, master script exists
  2. Dependency verification — renv.lock present, R version documented, Python deps documented
  3. Data provenance — Every dataset has documented source, access date, and restrictions
  4. Path hygiene — No hardcoded absolute paths, all paths use here::here()
  5. Output cross-reference — Every table/figure in the manuscript traces to a specific script
  6. README completeness — AEA format: data availability, computational requirements, program descriptions, instructions

Step 3: Handle Failures

If failures found:

  1. Display specific error with file and line number
  2. Suggest concrete fix
  3. Ask user if they want to fix and re-audit (max 3 iterations)

Step 4: Present Results

# Replication Audit Report
**Date:** YYYY-MM-DD
**Directory:** [path]

## Check Results
| # | Check | Status | Details |
|---|-------|--------|---------|
| 1 | Script syntax | PASS/FAIL | |
| 2 | File references | PASS/FAIL | |
| 3 | File integrity | PASS/FAIL | |
| 4 | Output freshness | PASS/FAIL | |
| 5 | Package inventory | PASS/FAIL | |
| 6 | Dependencies | PASS/FAIL | |
| 7 | Data provenance | PASS/FAIL | |
| 8 | Path hygiene | PASS/FAIL | |
| 9 | Output cross-reference | PASS/FAIL | |
| 10 | README completeness | PASS/FAIL | |

## Summary
- Checks passed: N / 10
- **Overall: PASS / FAIL**
- Blocking issues: [list]
- Positive findings: [list]

Save to output/log/replication_audit_[date].md.


Principles

  • Read and analyse only. Do not modify the package during audit.
  • Specific errors. "Script 03_robustness.R references data/final/panel.parquet which does not exist" beats "file reference error."
  • AEA Data Editor standards. The target is full compliance.
  • Path checking is critical. Any setwd() or absolute path is a FAIL for Check 8.
  • Restricted data awareness. Land Registry and Zoopla data may have access restrictions — document, don't block.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

a1

免费

Turn a broad research idea into clear, testable questions. Compare familiar and less conventional approaches, structure the selected question around its population and methods, and assess variables, feasibility, and potential theoretical contributions.

中文简介正在准备中。当前显示英语简介。

  • Turn a research topic into testable questions
  • Narrow an overly broad research question
  • Compare alternative research angles
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

a2

免费

Helps build a research framework by comparing theories, mapping relationships between variables, and deriving testable hypotheses. Explores less conventional options, examines weaknesses and competing explanations, and produces diagrams with anticipated reviewer objections.

中文简介正在准备中。当前显示英语简介。

  • Comparing theories for a research question
  • Deriving hypotheses from relationships between variables
  • Examining weaknesses and anticipated reviewer objections
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

a5

免费

Clarify the philosophical assumptions behind a research project and check whether they fit the proposed methods. Get a reasoned research stance, draft proposal wording, and guidance for explaining how the researcher's background and values shape the study.

中文简介正在准备中。当前显示英语简介。

  • Clarifying philosophical foundations for a research proposal
  • Explaining why the chosen research methods fit the study
  • Drafting a statement about the researcher's position
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

Plan and draft academic papers through specialized agent roles covering literature, arguments, citations, and review. Get chapter guidance, revision roadmaps, Traditional Chinese and English abstracts, and documents formatted as LaTeX, DOCX, PDF, or Markdown.

中文简介正在准备中。当前显示英语简介。

  • Planning a paper chapter by chapter
  • Drafting a paper from research materials
  • Turning reviewer comments into a revision roadmap
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

Turn a detailed outline into a philosophy or interdisciplinary manuscript. Draft chapters with repeated quality reviews, check terminology and arguments across sections, and prepare the manuscript, evaluation reports, abstract, and metadata for submission.

中文简介正在准备中。当前显示英语简介。

  • Draft a full paper from a detailed outline
  • Review argument and citation quality chapter by chapter
  • Check terminology and argument flow across chapters
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

Simulate academic peer review through five reviewer roles tailored to the paper's field. Receive separate critiques, an editorial decision, and a prioritized revision roadmap, or check whether a revised manuscript addresses earlier comments.

中文简介正在准备中。当前显示英语简介。

  • Review a manuscript before journal submission
  • Examine research methods and statistical validity
  • Challenge core arguments and alternative explanations
brycewang-stanford/Auto-Empirical-Research-Skills47462026年10月20日 更新

查看 brycewang-stanford 的全部技能

报告此技能的问题