本文へ移動
cccskills
無料GitHub で公開

jevaluate

Use when rating whether a project, repo, skill, workflow, plugin, agent product or post uses TypeSafe's Jev (System One) model well -- "is this a good use of Jev?", "rate this Jev integration", "jevaluate <url>", or a link to something named after Jev; also when checking whether something that calls itself Jev actually uses it.

インストール方法を見る

含まれるファイル(30)

  • SKILL.md2.3 KB
  • enforcement.md7.6 KB
  • fix-catalog.md5.6 KB
  • images/routing-dark.png515.7 KB
  • images/routing-light.png464.4 KB
  • ratings-template/LICENSE6.9 KB
  • ratings-template/README.md2.6 KB
  • ratings-template/unpublished.txt283 B
  • read.md6.7 KB
  • README.md4.8 KB
  • rubric.md32.2 KB
  • scripts/conftest.py432 B
  • scripts/coverage_manifest.py8.5 KB
  • scripts/fetch_repo.py4.4 KB
  • scripts/jev_callsites.py17.7 KB
  • scripts/library.py75.4 KB
  • scripts/rubric_text.py8.7 KB
  • scripts/screen_list.py6.2 KB
  • scripts/step.py8.0 KB
  • scripts/test_export_names.py2.9 KB
  • scripts/test_isolation.py472 B
  • scripts/test_library.py96.2 KB
  • scripts/test_lock_hardening.py2.6 KB
  • scripts/test_lock_round3.py5.9 KB
  • scripts/test_private.py3.8 KB
  • scripts/test_retro_2026_10_06.py4.9 KB
  • scripts/test_rubric_lock.py7.5 KB
  • scripts/test_rubric_text.py1.3 KB
  • scripts/test_scripts.py22.5 KB
  • scripts/test_step.py13.1 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Jevaluate

Rates how well something uses Jev, TypeSafe's System One model (typed questions over a JSON state, answered in parallel with calibrated probabilities). Every rating is evidence-backed, dated, tied to a commit, and logged, so the library of past ratings anchors future ones.

How to rate

Follow read.md; scripts/step.py serves the rubric, the fix rows and past ratings one phase at a time. Jevaluate rates projects; it doesn't run or diagnose your own pipeline. If asked for that, say so and stop.

Model

Run on a Sonnet-class model at medium effort, the same one every time: ratings stay comparable only if the rater doesn't change. In Codex, run on gpt-6-sol at medium effort. In another harness, pick one model and effort and keep them. Record both in the rating (rater, effort); a rating by a different model is a different rater's.

Verdicts

Verdicts run from 5 "Learn from it" down to the verdict-1 codes and "Can't rate yet", defined in rubric.md section 5. They come from the rules, never from averaging scores. Any verdict of 3 or below states its reasoning and the core fixes.

The library

Ratings are logged outside this skill, in $JEVALUATE_LIBRARY if set, else ~/.claude/jevaluate-library/ if it exists (libraries made before Codex support), else ~/.jevaluate-library/; scripts/library.py creates it. Never overwrite a past rating: a re-rating is a new dated entry.

Sources

Only public sources: the docs at docs.typesafe.ai (page list: https://docs.typesafe.ai/llms.txt; append .md to any page for markdown) and the project's own public files. Credit a repo to its GitHub owner, never to its banner or branding. A project's claims about its own results are claims until the rating checks them.

In Codex

Codex's default sandbox blocks the network and writes outside the workspace. Fetching a repo (gh, git) and library.py add need your approval, or run with network access and the library folder as a writable root.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

jev-lens

無料

Use when images (photos, illustrations, screenshots) need to become input for TypeSafe's Jev (System One) model, which reads only text -- "turn this photo into a Jev state", "describe these images for Jev", "decode images for System One", or a Jev project whose decision depends on what a picture shows. Handles 1 to about 100 images; produces a neutral, complete decode and a JSON state, checked against Jev.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when a question, review, design or claim involves Jev, TypeSafe, System One, Nouls, or Choice/Score questions, including whether something should be built with Jev, reviewing a Jev design, briefing a subagent on Jev work, or relaying a subagent's Jev finding.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when testing whether the jevaluate rubric and instructions lead graders to the right answers: after a rubric or instruction change, before freezing a rubric, before publishing ratings, or when a grader's calls look wrong.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when running a jevaluate rating round, re-rating after a rubric change, changing the jevaluate rubric, or publishing ratings to the jev-mode ratings folder.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

Use when rating a project with Jevaluate that must stay private -- "/jevaluate-private <link or folder>", "rate this privately", "evaluate my own project", a client's or employer's code, a design doc or a local folder that isn't public, or any rating that must not reach the public ratings or the repo.

日本語の概要は準備中です。原文の説明を表示しています。

tiffygk/jev-mode92026年10月15日 更新

tiffygk のスキルをすべて見る

このスキルの問題を報告する