本文へ移動
cccskills
無料GitHub で公開

jevaluate-harness

Use when running a jevaluate rating round, re-rating after a rubric change, changing the jevaluate rubric, or publishing ratings to the jev-mode ratings folder.

インストール方法を見る

含まれるファイル(23)

  • SKILL.md2.4 KB
  • fixtures/bad-rating-evidence/files/src__x.py103 B
  • fixtures/bad-rating.md1.5 KB
  • fixtures/bad-rating.md.steps.json517 B
  • fixtures/good-rating-evidence/files/src__x.py103 B
  • fixtures/good-rating.md1.5 KB
  • fixtures/good-rating.md.steps.json517 B
  • freeze_tag_check.py2.6 KB
  • images/skills-dark.png407.6 KB
  • images/skills-light.png364.7 KB
  • publish.md900 B
  • rater-brief.md2.1 KB
  • rating-round.md4.3 KB
  • README.md3.7 KB
  • rubric-change.md3.3 KB
  • scan_transcripts.py2.8 KB
  • scripts/check_release.py3.3 KB
  • scripts/dispute_packet.py3.6 KB
  • scripts/harness_status.py2.9 KB
  • test_dispute_packet.py2.3 KB
  • test_release.py2.1 KB
  • test_scan.py4.9 KB
  • test_status.py2.8 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Jevaluate Harness

The maintainer's process for jevaluate. One rating is jevaluate/read.md; testing the rubric is the jevaluate-eval skill. If $JEVALUATE_OVERLAY is set, read that file first; its rules override the defaults here.

Settings (yours, not in this skill)

  • $JEVALUATE_LIBRARY: the private ratings library (default ~/.claude/jevaluate-library if it exists, else ~/.jevaluate-library).
  • $PRIVATE_TERMS: your never-publish regexes, one per line. library.py export reads only $JEVALUATE_LIBRARY/private-terms.txt, so keep the file there (or symlink it) and have your pre-push hook read the same file.
  • $JEVALUATE_OVERLAY: a markdown note of your own rules for these workflows, read first; no required format.

Two principles

  • Code checks, text explains: every rule has a row in jevaluate/enforcement.md naming the check that refuses a wrong answer, or why it stays judgment.
  • Ask for what is observed: raters record type, the calls-Jev line, each decision's stakes as read and the verdict; library.py add derives kind and every n.a.

Workflows

Open the file for the workflow and follow it in order; each step names the gate that must pass.

WorkflowFileDone when
Change the rubricrubric-change.mdjevaluate-eval passes and the owner approves the version
Rate or re-rate projectsrating-round.md (rater prompt: rater-brief.md)every rating logged by library.py add, scan clean
Publish ratingspublish.mdone pull request, reviewed

To see where you are: python3 jevaluate-harness/scripts/harness_status.py <ledger> --workflow rubric|round (round runs through publishing). It reruns the scripted gates it has (the materials check), reads the other steps from the ledger, and names the file to open next. Ledger lines: done: <step> <YYYY-MM-DD> <evidence>. Steps: rubric = rules-written, materials-checked, quiz-passed, eval-passed, owner-approved, frozen; round = picked, sized, costs-approved, rated, scanned, adjudicated, final-gate, release-check, published.

Keep a ledger per workflow: each step, each ruling with its cost if wrong, and tokens per agent. Record rulings and handoffs where your overlay says, or in the ledger.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

jev-lens

無料

Use when images (photos, illustrations, screenshots) need to become input for TypeSafe's Jev (System One) model, which reads only text -- "turn this photo into a Jev state", "describe these images for Jev", "decode images for System One", or a Jev project whose decision depends on what a picture shows. Handles 1 to about 100 images; produces a neutral, complete decode and a JSON state, checked against Jev.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when a question, review, design or claim involves Jev, TypeSafe, System One, Nouls, or Choice/Score questions, including whether something should be built with Jev, reviewing a Jev design, briefing a subagent on Jev work, or relaying a subagent's Jev finding.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

jevaluate

無料

Use when rating whether a project, repo, skill, workflow, plugin, agent product or post uses TypeSafe's Jev (System One) model well -- "is this a good use of Jev?", "rate this Jev integration", "jevaluate <url>", or a link to something named after Jev; also when checking whether something that calls itself Jev actually uses it.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when testing whether the jevaluate rubric and instructions lead graders to the right answers: after a rubric or instruction change, before freezing a rubric, before publishing ratings, or when a grader's calls look wrong.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when rating a project with Jevaluate that must stay private -- "/jevaluate-private <link or folder>", "rate this privately", "evaluate my own project", a client's or employer's code, a design doc or a local folder that isn't public, or any rating that must not reach the public ratings or the repo.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

tiffygk のスキルをすべて見る

このスキルの問題を報告する