Skip to content
cccskills
FreePublished on GitHub

safe-data-handling

Use this when reading, writing, moving, copying, modifying, deleting, or generating data files — including any operation that touches data/raw, data/external, data/interim, data/processed, or outputs directories.

The English summary is being prepared. Showing the original description.

See how to install

Files included (1)

  • SKILL.md2.5 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Skill: Safe Data Handling

Use this skill before reading, writing, moving, modifying, deleting, or generating data files.

Hard Rules

  • Never commit raw data, credentials, API keys, tokens, or customer-level records.
  • Never directly modify, overwrite, delete, or regenerate raw data.
  • Treat data/raw/ and data/external/ as immutable.
  • Write derived data to data/interim/, data/processed/, or outputs/.
  • Before writing output, confirm the target path is not under data/raw/ or data/external/.

Recommended Workflow

  1. Identify whether input data is raw, external, interim, processed, or output.
  2. Read raw/external data as immutable input — never modify the source.
  3. Write generated artifacts to a separate output path (data/interim/, data/processed/, or outputs/).
  4. Summarize files read and written at the end of the operation.

Directory Roles

DirectoryRoleMutable?
data/raw/Original source dataNo
data/external/Third-party reference dataNo
data/interim/Intermediate transformsYes
data/processed/Final cleaned/derived dataYes
outputs/Figures, tables, reportsYes

PII and Customer-Level Records

  • Do not include personally identifiable information (PII) or customer-level records in committed files.
  • If analysis requires customer-level data, keep it in data/raw/ (gitignored) and never commit.
  • Aggregated or anonymized outputs are acceptable for data/processed/ or outputs/.
  • When in doubt, ask before writing customer-level data to any path.
  • Analysis outputs must not allow individuals to be re-identified.

Credentials and Secrets

  • .env is gitignored. .env.example lists key names only — never real values.
  • Do not hard-code API keys, tokens, or passwords in code or notebook outputs.
  • Load secrets from environment variables with python-dotenv.

Verification

data/raw/ and data/external/ are gitignored, and CI enforces the rules above:

uv run python scripts/check_no_raw_data_commit.py    # rawデータのコミットを検知
uv run python scripts/check_no_sensitive_patterns.py # 秘密情報のパターンを検知

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Use this when summarizing analysis results, writing reports, documenting experiment outcomes, or presenting model evaluation — including structuring findings in Japanese with conclusions, facts, assumptions, interpretations, and caveats.

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

因果推論・効果検証(A/B テスト / ABテスト / オンライン実験 / リフト / SRM / CUPED、観察データの処置効果 / ATE / ATT / CATE / 傾向スコア / propensity score / IPW / 二重頑健 / DML / causal forest、準実験 / 差の差 / DiD / イベントスタディ / 操作変数 / IV / 2SLS / 回帰不連続 / RDD / 合成コントロール)を実行したら必ずセットで出す図と値のルーター。 proportions_ztest, chisquare, statsmodels.stats.power, dowhy, econml, causalml, doubleml, propensity, LinearDML, IV2SLS, rdrobust, rddensity, pysyncon, treat*post がコードに現れたとき、またはユーザーが「ABテストの結果を 見て」「施策の効果を推定して」「差の差で」「傾向スコアで揃えて」「閾値前後で比較して」と言ったときに使う。SRM・ バランス・並行トレンド・first-stage に言及がなくても適用する。SKILL.md のルーティング表で設計を特定し、対応する references/<設計>.md を読んでから実行する。実験でない群間比較の検定は statistical-inference-diagnostics、 予測モデルの解釈(SHAP 等)は predictive-modeling-diagnostics を使う。

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

Use this when performing DataFrame operations — including loading, filtering, joining, aggregating, transforming, or reshaping tabular data with polars or pandas.

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

Use this when creating, editing, executing, or reviewing Jupyter notebooks — including cell structure, kernel management, extracting reusable logic to src/, and ensuring notebooks are restartable.

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

Use this when reading from or writing to local files — including constructing file paths with pathlib, creating directories, choosing output locations, and using path utilities from src/analysis_project/paths.py.

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

分析を始める前に構造化された分析計画を作成する

The English summary is being prepared. Showing the original description.

atsushi-green/ds-ai-coding-skills91Updated Oct 4, 2026

See all skills by atsushi-green

Report a problem with this skill