本文へ移動
cccskills
無料GitHub で公開

trust-methodology-consult

Consult this skill BEFORE proposing a fix to any CLI gap or schema gap that touches evidence, trust magnitude, evidence types, evidence grades, the TM formula, or star-level promotion gates. Also read it whenever an issue mentions citations, stars, commits, contributors, views, reviewers, percentile, arxiv, github-stars-own, repo-own, social-signal, benchmark-result, peer-review, self-attestation, fusion-recipe, verifier-attestation, or proxy-containment — those are the 10 canonical evidence types and the raw inputs that feed their formulas. Also read it when asked whether a skill qualifies for a given star level (0★–6★): the Star Bar and promotion gates live in `META.md`, not in the TM methodology page. Reading both prevents proposing a calibration that satisfies the TM grade threshold but violates a Star Bar installability or link requirement.

インストール方法を見る

含まれるファイル(2)

  • SKILL.md9.8 KB
  • scripts/recompute_one_tm.py4.0 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Consult the trust methodology before touching CLI/schema evidence surface

The Gaia trust surface is a three-layer contract. Skipping any layer when proposing a fix guarantees you either widen or narrow it incorrectly:

LayerSource of truth
Concept — what the numbers mean and why they existdocs/codex/trust-methodology.html (also mirrored in docs/meta/2026-06-trust-methodology.md and the G7 supersession note at docs/meta/2026-06-17-g7-trust-magnitude-supersession.md)
Compute — how the numbers are actually producedsrc/gaia_cli/trustMagnitude.py (backend); docs/js/tm-config.js (frontend SoT)
Persistence — what shape the CLI writes and the schema boundssrc/gaia_cli/commands/dev/evidence.py (writer) + registry/schema/skill.schema.json + registry/schema/namedSkill.schema.json (bounds)
Star level gates — what a skill must satisfy to hold 0★–6★META.md §2 (Star Bar, installability, blob-link requirement, 4★+ live evidence rule, Specialist Path rubric, Apex 6-predicate gate (Suite branch, §4.3) and the provisional Unique Impossible 5-predicate gate (Unique branch, §4.4))

When an issue lands as "CLI gap" or "schema gap" on this surface, ONE of those layers is out of step with the other two. Your first job is to identify which.

Star Bar — read META.md before calibrating any 3★+

The TM methodology page covers how scores are computed. It does not cover what a skill must have to hold a given star level. Those gates live in META.md §2 and must be checked independently:

LevelGate
0★–2★No link requirement; installable: false permitted
3★+links.github must be a verified blob URL (.../blob/<branch>/...). Bare repo root → hard-demote to 1★.
4★+Live, verifiable usage evidence required. Seed/placeholder evidence is insufficient.
4★+ SpecialistVendor-locked skills: Depth-of-Integration rubric (META.md §2.3)
6★ Suite (Apex)Grade S + 6-predicate Apex gate (META.md §4.3)
6★ Unique (Unique Impossible)Grade S + provisional 5-predicate gate (Apex set minus directNestedSuiteGte1, META.md §4.4; branch distinction ratified under Yggdrasil III, predicate set otherwise unchanged)

When asked "should this skill be 4★?", run this check before computing TM:

  1. Does links.github point to a concrete file via /blob/?
  2. Is every scoring evidence row live and non-seed?
  3. Does overallTrustGrade ≥ B (TM ≥ 50)? Grade A (TM ≥ 100) is the norm for 4★ in practice.

If any gate fails, the correct action is to fix the gate or demote — not to add more evidence rows to compensate.

The read pass — do this before writing code

  1. Read the methodology page. Open docs/codex/trust-methodology.html. The "10 evidence types — base formula at a glance" table (search for base formula) lists every evidence type and the raw input fields its formula consumes. Confirm the field the issue names appears there.
  2. Confirm the CLI writes it. Grep src/gaia_cli/commands/dev/evidence.py for the field name. If the flag exists and the writer stores it, the CLI already treats that field as persistable.
  3. Confirm the TM engine reads it. Grep src/gaia_cli/trustMagnitude.py for the field name via row.get("<field>", ...). If the engine reads it, the field is a first-class input, not a derived value.
  4. Confirm the schema declares it. Open the relevant evidenceEntry definition and check the properties block. Because both schemas set additionalProperties: false, any field the CLI writes but the schema does not list will be rejected on the first gaia dev validate run — which is exactly what surfaces most of these gaps.
  5. Validate the failure locally, don't infer it. Write a tiny probe file with the field, run jsonschema.validate(instance, schema), and observe the exact rejection path. Do not trust an issue's diagnosis until the local repro matches.

The design principle you must not violate

The methodology page states, verbatim:

Trust Magnitude (TM) is the aggregate numeric signal for a skill's trustworthiness. It is computed at build time from a skill's evidence inventory, never stored on a node.

That sentence pins the direction of every fix:

  • Raw inputs are the persisted state. Fields like citations, stars, commits, contributors, views, reviewers, percentile, and skillCountInRepo are the evidence inventory. They MUST be storable on an evidence row so gaia dev calibrate-evidence-grades can re-derive grades from them at any future time.
  • Derived fields are ephemeral. trustMagnitude and overallTrustGrade are computed. They may appear on the merged graph or in reports but must not become the persistence contract — otherwise you cannot recompute them when the formula changes.
  • Do not "collapse" raw inputs into trustNumber as a workaround. Writing only a pre-computed trustNumber to sidestep a schema rejection erases the audit chain ("why did this row score 73?") and breaks the recompute path. It is a legitimate one-off remediation when a schema fix is blocked; it is never a design.

Decision matrix — what kind of gap is it?

SymptomMost likely gapFix direction
CLI writes field X; TM engine reads field X; schema rejects XSchema gap — schemas lag documented realityAdd X to evidenceEntry.properties in both skill.schema.json and namedSkill.schema.json; keep the two schemas symmetric
CLI writes field X; TM engine ignores X; schema silentCLI over-writes — the field is dead weightRemove the write in evidence.py; document why
CLI has no flag for X; TM engine reads X; schema silentCLI gap — TM depends on data no operator can addAdd the flag + writer, then verify schema accepts it (add if needed)
Methodology page mentions a metric not in the CLI or TM engineDoc drift — treat as spec, not lawOpen a discussion issue before touching any of the three layers

The write pass — order matters

The methodology page's own "if you change a formula" checklist applies, in this exact order. Do not skip a step or reorder them:

  1. docs/js/tm-config.js — frontend SoT for the formula
  2. src/gaia_cli/trustMagnitude.py — backend implementation
  3. docs/codex/trust-methodology.html — the doc itself
  4. registry/schema/meta.json — perRowGradeThresholds and gradeCeiling
  5. tests/test_row_grading.py + tests/test_calibrate_evidence_grades.py
  6. python scripts/build_docs.py — regenerate everything
  7. gaia dev calibrate-evidence-grades --yes — refresh stored grades

If the gap is schema-only (as in Issue #941 — the field is already read and written, only the schema disagrees), most of that list does not apply — only steps 4-ish (extend the schema), 6 (regen docs), and 7 (rerun the calibration if any stored grade shifted) matter. Small schema changes still belong on a schema/* branch per the branch-scope rules.

Helper: recompute a single node's stored TM (scripts/recompute_one_tm.py)

A recurring flavour of CLI gap: the live CLI does not recompute and persist a named skill's trustMagnitude/overallTrustGrade when evidence is added, a suite is fused, or a level is calibrated. The leaderboard recomputes at build time (computeTrustMagnitude) and looks correct, but consumers that trust the stored frontmatter field — the contributors API, badges, and the Hall-of-Heroes topSkill selection — keep showing the stale value.

Until that write-back is closed in gaia dev, use the vendored helper for a surgical, idempotent, single-node fix (it reuses the canonical write-back logic from scripts/archive/migrateTrustMagnitude.py, so no unrelated node is swept into the diff):

python3 .claude/skills/trust-methodology-consult/scripts/recompute_one_tm.py <owner/skill-id> --dry-run
python3 .claude/skills/trust-methodology-consult/scripts/recompute_one_tm.py <owner/skill-id>
gaia dev docs   # propagate the new value into docs/ artifacts

This is a remediation, not a design — the durable fix is to make the mutation commands recompute+persist. Do not hand-edit the stored fields.

What NOT to do

  • Do not "just remove the field" from the CLI when the TM engine still reads it — you'll silently zero out every skill's citations-based magnitude.
  • Do not add the field to only one of the two schemas. Named and generic evidence entries share the same shape; asymmetric schemas guarantee the next reviewer will re-file the same issue.
  • Do not persist a pre-computed trustNumber in place of the raw input as a "design" — see "The design principle you must not violate" above.
  • Do not re-derive the answer from memory. The methodology has been superseded once already (2026-06-17, G7). Always re-read the page before acting.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

ci-churn

無料

Measure CI churn cost for a pull request: how many commits and how many CI-compute seconds were burned on avoidable "fix the CI" push rounds. Use when you want to understand the efficiency cost of a PR's iteration cycle, get actionable pre-push check suggestions, or include a churn summary in a pipeline report. Triggers: "ci churn", "how much CI did we burn", "avoidable commits", "ci efficiency", "wasted CI time", "churn report", "/ci-churn". Called automatically by /fp-drift at pipeline close.

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

Produce the rendered evidence a human-gated frontend PR owes its reviewer: capture each changed surface (plus the before state for anything modified, plus mobile width), then generate one self-contained local HTML page the founder can open and review without checking anything out. Use when a PR is gated by the "Frontend changes are HUMAN-GATED" section of CLAUDE.md, or when the user says "/design-gate", "screenshot evidence for this PR", "prep this for founder review", "build the design evidence page", "what does this look like before and after". The page comes from a template script, not hand-written markup. Output is session-local and never committed. Do NOT use for non-gated changes: typo/grammar/factual fixes in an unchanged block, dead link targets, alt/ARIA fixes with no visual change, cache-bust bumps, or refactors with no rendered diff.

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

One-fix-at-a-time, approval-gated design fix recovery. Given a checklist of fixes (handover doc, CHECKLIST.md, or inline list), applies each individually, presents a diff, and waits for an explicit APPROVE / REJECT / NO CHANGES decision before committing. Trigger phrases: /design-iteration, "go through the checklist one by one", "fix these one at a time", "bucket recovery", "design fix pass".

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

Playbook for correcting a named skill's star level to match its computed Trust Magnitude grade, with an independent post-calibration verification pass and a CLI-logged timeline event (never hand-written). Use when: recalibrating a skill's level, fixing a stale or drifted star rating, running a batch of `gaia dev calibrate` corrections, or confirming a past calibration actually landed. Triggers: "calibrate <skill>", "recalibrate the trust magnitude backlog", "promote/demote <skill> to N stars", "why is <skill> still N stars", "verify a calibration actually landed", "Hall of Heroes ranking is wrong".

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

Close out a completed EPIC / sprint end-to-end: author a fact-verified meta-post announcing what shipped, archive the EPIC's handovers, snapshot orchestrator memory, gate the integration→main merge on CI-green + explicit human go, drive the version bump (merge-commit conventions that auto-sync classifies), and verify the release reached the registry/PyPI. Use when the user says "close out EPIC <n>", "wrap up the sprint", "ship the meta shift", "/epic-close", or asks to finalize an integration branch that is ready to merge to main. Generalizes the EPIC 1002 (Yggdrasil II) close-out. This skill orchestrates — it authors founder docs directly (superadmin) and delegates code/regen to workers; it NEVER merges to main without the human gate.

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

Run this skill for Phase 3 of the evidence verification pipeline — the adversarial audit step. Use when you need to check the evidence data lake for bad data before ingestion: dead links, wrong URL formats (tree/ vs blob/), subjective wording ("elite", "high-quality"), stale migration notes, benchmark catalog misuse/vendor-claim leakage, or skills whose star evidence conflicts with classified evidence level. Triggers on phrases like: "audit the data lake", "adversarial check", "ev-adversarial-audit", "check for noise in evidence", "flag bad evidence", "run the audit phase", "quality check the by-type files", or any reference to Phase 3 of the pipeline.

日本語の概要は準備中です。原文の説明を表示しています。

gaia-research/gaia-skill-tree232026年10月13日 更新

gaia-research のスキルをすべて見る

このスキルの問題を報告する