跳到正文
cccskills
免费在 GitHub 公开

robustness

Plan robustness checks for finance and economics papers to assess whether findings hold under different samples, variable definitions, and modeling choices. Get method-specific checklists, test priorities, and a template for presenting results.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

Checklist of empirical robustness tests for finance/economics papers

实测评分 未实测

查看安装方法

适用场景

  • Reviewing robustness checks before submitting a paper
  • Choosing checks for difference-in-differences analysis
  • Planning tests for instrumental variable estimates
  • Prioritizing checks and organizing results tables

包含的文件(1)

  • SKILL.md5.3 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Robustness Test Checklist

Systematic checklist of robustness tests for empirical research. Use this to ensure comprehensive testing before submission.


Core Robustness Categories

1. Alternative Samples

TestDescriptionWhen to Use
Exclude outliersWinsorize/trim at different levels (0.5%, 2%, 5%)Always
Drop financial firmsExclude SIC 6000-6999If not already excluded
Drop regulated industriesExclude utilities, telecomsIndustry-specific effects
Different time periodsSplit sample pre/post crisis, early/lateResults may be period-specific
Geographic subsamplesBy region, state, countryExternal validity
Size subsamplesSmall vs. large firmsHeterogeneous effects
Balanced panelRequire continuous observationsSurvivorship concerns

2. Alternative Specifications

TestDescriptionWhen to Use
Different fixed effectsFirm, industry×year, state×yearControl for unobservables
Additional controlsAdd variables referees might suggestOmitted variable concerns
Drop controlsVerify not over-controllingMediator concerns
Different clusteringFirm, industry, state, two-wayInference robustness
Different standard errorsBootstrap, Newey-West, Driscoll-KraaySerial/cross-sectional correlation
Nonlinear specificationsQuadratic terms, splinesLinearity assumption
Log vs. levelTransform dependent variableSkewed distributions

3. Alternative Measures

TestDescriptionWhen to Use
Alternative dependent variableDifferent proxy for same conceptMeasurement concerns
Alternative treatment measureContinuous vs. binary, different thresholdTreatment definition
Alternative control measuresDifferent proxies for size, leverage, etc.Standard practice
Scaled differentlyBy assets, sales, employeesScaling choice matters

4. Identification Tests

TestDescriptionWhen to Use
Placebo/Falsification
Placebo timingFake treatment 1-3 years before actualDiD parallel trends
Placebo outcomeEffect on outcome that shouldn't be affectedSpecificity of mechanism
Placebo treatmentRandom assignment of treatmentRule out spurious correlation
Pre-trends
Event study plotCoefficient for each pre/post periodVisual parallel trends
Joint F-testTest pre-period coefficients = 0Statistical parallel trends
Endogeneity
Instrumental variablesFind exogenous variationSelection concerns
Heckman selectionModel selection explicitlySample selection
Propensity score matchingMatch treated/controlObservable selection
Entropy balancingReweight to balance covariatesCovariate imbalance
Regression discontinuityIf threshold existsSharp identification

5. Inference Robustness

TestDescriptionWhen to Use
Wild cluster bootstrapSmall number of clusters<50 clusters
Randomization inferencePermutation-based p-valuesFew treated units
Conley standard errorsSpatial correlationGeographic data
Multiple hypothesis correctionBonferroni, FDRMany outcomes tested

DiD-Specific Tests

For difference-in-differences designs:

  • Event study with pre-treatment coefficients
  • Parallel trends test (formal)
  • Bacon decomposition (staggered treatment)
  • Callaway-Sant'Anna or Sun-Abraham estimator (heterogeneous treatment effects)
  • Placebo treatment timing
  • Vary treatment window
  • Triple-difference if possible
  • Exclude always-treated or never-treated

IV-Specific Tests

For instrumental variables:

  • First-stage F-statistic (>10, prefer >100)
  • Weak instrument robust inference (Anderson-Rubin)
  • Overidentification test (if multiple IVs)
  • Exclusion restriction discussion
  • Reduced form results
  • Compare OLS vs. IV magnitudes

Quick Commands

  • "robustness checklist" - Full checklist for current paper
  • "DiD robustness" - DiD-specific tests only
  • "what tests for [method]" - Tests for specific identification strategy
  • "referee-proof" - Most commonly requested tests
  • "prioritize tests" - Rank by importance for your setting

Referee-Proof Minimum

At minimum, most papers should include:

  1. Sample robustness: Exclude outliers, alternative time periods
  2. Specification robustness: Alternative fixed effects, controls
  3. Measurement robustness: Alternative variable definitions
  4. Inference robustness: Alternative clustering
  5. Identification test: At least one placebo or pre-trend test

Reporting Template

For robustness tables:

Table X: Robustness Tests
Panel A: Alternative Samples
  (1) Baseline
  (2) Exclude financial firms
  (3) Exclude 2008-2009
  (4) Winsorize at 5%

Panel B: Alternative Specifications
  (5) Add industry×year FE
  (6) Control for firm age
  (7) Cluster by industry

Panel C: Alternative Measures
  (8) Alternative dependent variable
  (9) Continuous treatment measure

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

a1

免费

Turn a broad research idea into clear, testable questions. Compare familiar and less conventional approaches, structure the selected question around its population and methods, and assess variables, feasibility, and potential theoretical contributions.

中文简介正在准备中。当前显示英语简介。

  • Turn a research topic into testable questions
  • Narrow an overly broad research question
  • Compare alternative research angles
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

a2

免费

Helps build a research framework by comparing theories, mapping relationships between variables, and deriving testable hypotheses. Explores less conventional options, examines weaknesses and competing explanations, and produces diagrams with anticipated reviewer objections.

中文简介正在准备中。当前显示英语简介。

  • Comparing theories for a research question
  • Deriving hypotheses from relationships between variables
  • Examining weaknesses and anticipated reviewer objections
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

a5

免费

Clarify the philosophical assumptions behind a research project and check whether they fit the proposed methods. Get a reasoned research stance, draft proposal wording, and guidance for explaining how the researcher's background and values shape the study.

中文简介正在准备中。当前显示英语简介。

  • Clarifying philosophical foundations for a research proposal
  • Explaining why the chosen research methods fit the study
  • Drafting a statement about the researcher's position
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

Plan and draft academic papers through specialized agent roles covering literature, arguments, citations, and review. Get chapter guidance, revision roadmaps, Traditional Chinese and English abstracts, and documents formatted as LaTeX, DOCX, PDF, or Markdown.

中文简介正在准备中。当前显示英语简介。

  • Planning a paper chapter by chapter
  • Drafting a paper from research materials
  • Turning reviewer comments into a revision roadmap
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

Turn a detailed outline into a philosophy or interdisciplinary manuscript. Draft chapters with repeated quality reviews, check terminology and arguments across sections, and prepare the manuscript, evaluation reports, abstract, and metadata for submission.

中文简介正在准备中。当前显示英语简介。

  • Draft a full paper from a detailed outline
  • Review argument and citation quality chapter by chapter
  • Check terminology and argument flow across chapters
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

Simulate academic peer review through five reviewer roles tailored to the paper's field. Receive separate critiques, an editorial decision, and a prioritized revision roadmap, or check whether a revised manuscript addresses earlier comments.

中文简介正在准备中。当前显示英语简介。

  • Review a manuscript before journal submission
  • Examine research methods and statistical validity
  • Challenge core arguments and alternative explanations
brycewang-stanford/Auto-Empirical-Research-Skills47482026年10月20日 更新

查看 brycewang-stanford 的全部技能

报告此技能的问题