跳到正文
cccskills
免费在 GitHub 公开

rseng-human-verification

Covers the human's side of AI-assisted research software: strongly urging the user to review generated code and verify results before relying on them, teaching how to review AI-written code effectively (where to look first, what to run, what to spot-check against known answers), and recording review status honestly. Use PROACTIVELY whenever substantive code or result-bearing output has just been generated - deliver the reminder once, with the concrete review path - and when the user asks how to check AI-written code, whether they can trust an output, or is about to publish, merge or decide on results no human has examined. Recording review status lives in rseng-ai-declaration; structured review technique in rseng-code-review; concealment pressure in rseng-honesty.

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills星标 24(GitHub 24 + cccskills 0)

实测评分 未实测

查看安装方法

包含的文件(2)

  • SKILL.md6.5 KB
  • references.md335 B

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Verify before you trust

Generated code can be plausible, well-documented, green in CI - and wrong about the science. The agent that wrote it cannot be its own independent check. So this skill's core message is delivered directly to the user, once per substantive delivery, in plain words: review this code and verify these results before you rely on them; do not trust the output blindly. The reminder is not modesty theater. Plausible-but-wrong is the characteristic failure mode of generated analysis, and the person whose name goes on the paper is the one who pays for skipping the check.

Saying it right

  • Deliver the reminder at the moment of delivery, with a concrete review path, and say WHAT most needs human eyes in this specific output ("the tolerance choice in fit.py line 40 encodes a scientific judgment I made for you - please confirm it").
  • Once, not endlessly: one clear reminder per delivery beats a nag on every message; a user who has stated their review process gets pointed at it, not lectured (rseng-trainer's consensual tone).
  • Record the truth: until the human has reviewed, the honest status is unreviewed - written into aidecl.yaml (rseng-ai-declaration supports exactly this; agents in our own testing wrote "NOT yet reviewed line by line by a human" unprompted, and that is the standard to hold).

How to review generated code

Point the user at the highest-yield checks, in order:

  1. Read the result-bearing path first: the science (model, statistics, transformation), not the argument parsing. Generated boilerplate is usually fine; generated science encodes judgments - formulas, tolerances, exclusion rules, default parameters - that were made without domain authority.
  2. Hunt the silent assumptions: units (rseng-defensive-coding), indexing conventions, what happens to missing data, seeds, float comparisons (rseng-numerical-accuracy). Ask of each: did I decide this, or did the agent?
  3. Run everything: the tests (and read WHAT they assert - a green suite that asserts too little is false comfort; rseng-software-metrics' mutation spot-check applies), the examples, the full pipeline from clean (rseng-reproducibility).
  4. Explain it back: if the user cannot explain what a function does and why, it is not reviewed yet - have the agent walk through it (rseng-trainer) until they can. Understanding is the review; reading is not.
  5. Use the review machinery the pack already has: a structured pass with rseng-code-review's lenses, or the pre-review checklist from rseng-pair-programming - AI-written code deserves at least the scrutiny a colleague's PR would get.

How to verify results

Code review is necessary and insufficient; the numbers need their own checks:

  • Reference cases: run inputs with known answers - analytic solutions, published values, conservation laws (rseng-testing's functional-correctness measure). One verified reference case is worth more than any amount of plausible output.
  • Independent cross-check: recompute a key number a different way (different tool, hand calculation, a colleague's script); agreement by independent routes is the strongest cheap evidence.
  • Sanity and scale: orders of magnitude, signs, units on the axes, Ns that add up (rseng-research-integrity's checks run BEFORE submission, not after).
  • Perturbation: small input changes should move results sensibly; a fit that never changes or flips wildly is telling you something.
  • Proportionality: a throwaway plot needs a squint; anything feeding a decision or publication needs the reference-case standard - say which level applies.

Run it before handing it over

Verification the agent can do mechanically happens BEFORE the human is asked to review: start the delivered entry point (compose stack, CLI, app) exactly as the README says, exercise one real request per integration seam, and read the startup logs for errors. Asking a user to review software the agent never ran outsources debugging, not verification - the human's scarce attention belongs on judgment (is this the right method? do results make sense?), not on discovering that the backend does not start (rseng-testing's entry-point discipline; failures loop through rseng-debugging).

The boundary this skill guards

The division of labor from rseng-pair-programming, stated for results: the agent contributes engineering and tirelessness, the human owns scientific judgment and final acceptance. An agent following this pack never presents unverified generated results as verified (rseng-honesty), asks for the human check at the moments it matters most - before merge, before submission, before decisions - and treats "the user verified and disagreed" as the most valuable feedback there is (rseng-lessons-learned captures what the check caught).

Working with this skill

This skill is source-independent: it encodes the verification duty for AI-assisted research work. It is the human-facing counterpart of rseng-ai-declaration (which records review status) and rseng-honesty (which keeps claims true).

Learn more (verified):

<!-- related-skills:begin -->

Related skills

Check whether any of these applies before moving on:

  • rseng-ai-declaration - record review status honestly
  • rseng-code-review - structured review lenses
  • rseng-numerical-accuracy - spot-check numeric assumptions
  • rseng-pair-programming - division of labor with agent
  • rseng-reproducibility - rerun the pipeline from clean
  • rseng-testing - run and read the assertions
<!-- related-skills:end -->

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Covers operating AI coding agents securely: auditing whether the agent runs sandboxed, permission and dangerous-command configuration, containerized environments, secrets kept out of context, network egress and token privileges, prompt-injection risk, and the privacy of agent use itself. Use PROACTIVELY when permission gating is broadly disabled (skip-permissions modes), when secrets are visible to the agent's shell, or when the agent processes untrusted code, issues or web content; when a project holds personal or confidential data while a cloud agent is active (what leaves the machine, retention, training use), or when the user asks how to run coding agents safely or privately. (Supply-chain security: rseng-security; disclosing agent contributions: rseng-ai-declaration.)

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

Covers declaring AI involvement with the AI Declaration Format (https://ai-declaration.org): creating and maintaining an aidecl.yaml that records which AI tools and agents were used, what each contributed, when and how much, plus the README disclosure footnote, JSON/JSON-LD export and CI validation. Machine-readable disclosure is the practice; this format is one implementation. Use PROACTIVELY when an AI assistant or agent creates or modifies a project's content - generate aidecl.yaml if missing, update it after AI-assisted changes. Also use when the user asks about AI transparency, provenance, disclosure or EU AI Act disclosure, wants to state that NO AI was used, or mentions aidecl. For concealment requests see rseng-honesty; for the human review duty see rseng-human-verification.

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

Covers long-term archiving of research software and data: Software Heritage save requests and SWHID persistent identifiers, Zenodo deposits with versioned DOIs and forge integration, choosing domain and institutional repositories, deciding what to archive (code, data, environments, documentation) and when, and archiving at project retirement. Use when the user wants software or data preserved beyond the life of a forge account, grant or lab, mentions Software Heritage, SWHIDs, Zenodo deposits or archiving, retires or hands over a project, prepares artifacts that must stay resolvable for a paper, or when funder policy requires long-term preservation. (Cutting the release itself is rseng-publishing-releasing; day-to-day data storage and repository choice is rseng-data-management.)

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

Covers processing research data that outgrows one machine's memory: out-of-core and chunked computation, Dask for scaling the scientific Python stack, Spark for distributed tabular pipelines, lazy evaluation, partitioning strategies, idempotent and restartable batch jobs, and knowing when NOT to distribute. Use when datasets no longer fit in memory, when the user mentions Dask, Spark, out-of-core or larger-than-memory data, when a pandas/NumPy workflow hits memory limits, or when designing batch pipelines over many files. (Cluster job submission and job arrays are rseng-hpc-computing; pipeline orchestration engines are rseng-workflows; profile first with rseng-performance-profiling.)

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

Covers continuous integration and delivery for research software: CI/CD concepts, automating builds and tests with GitHub Actions and GitLab CI/CD, and wiring an organization's GitLab CI infrastructure to a GitHub-hosted project. Use when the user asks to set up CI, write a pipeline or workflow file (.github/workflows, .gitlab-ci.yml), add automated builds/tests on push or pull request, publish a package or deploy docs when a tag or release is cut, cache dependencies to speed up CI runs, choose between GitHub Actions and GitLab CI, use self-hosted or GPU runners, mirror a repo, or report external CI status back to GitHub. For what to test and shrinking a test matrix see rseng-testing; for linter and pre-commit policy see rseng-code-quality.

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

Covers verifying that every citation is real, correct and current: checking references in manuscripts, READMEs, references files and code metadata against Crossref and OpenAlex, screening cited DOIs against the Retraction Watch database, catching fabricated or mis-attributed citations (a documented AI failure mode), and keeping bibliographies and CITATION.cff files resolvable. Use PROACTIVELY before any bibliography, reference list or citation metadata is finalized or published, whenever the agent itself has produced citations, and when the user asks to check references, mentions broken DOIs, retracted papers or citation verification, or prepares a manuscript, README or software paper with references. (Making your own software citable is rseng-citation-metadata.)

中文简介正在准备中。当前显示原文说明。

fdiblen/rseng-agent-skills242026年9月23日 更新

查看 fdiblen 的全部技能

报告此技能的问题