Skip to content
cccskills
FreePublished on GitHub

nemoclaw-maintainer-pr-comparator

Compare multiple NemoClaw pull requests addressing the same issue. It checks merge eligibility, correctness, quality, and attribution, then produces an evidence-based recommendation for merging or choosing a candidate for further repair.

OriginalShow the original description

Compare competing NemoClaw PRs for one issue and recommend a merge or salvage candidate from review evidence.

See how to install

Good for

  • Comparing competing pull requests for one issue
  • Checking merge eligibility before ranking proposals
  • Choosing a candidate to repair when none is ready
  • Reviewing attribution when work moves between pull requests

Files included (13)

  • SKILL.md6.9 KB
  • checks/tier-0-gates.md3.6 KB
  • checks/tier-1-correctness.md3.7 KB
  • checks/tier-2-quality.md2.9 KB
  • repo-policy.md2.8 KB
  • scripts/check-coderabbit-threads.sh2.8 KB
  • scripts/collect-gates.sh9.1 KB
  • scripts/find-candidates.sh3.7 KB
  • scripts/parse-supersession.sh2.5 KB
  • scripts/render-verdict.py10.6 KB
  • templates/verdict.md4.6 KB
  • tiebreakers.md3.7 KB
  • validation/backtest.md3.1 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

<!-- SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. --> <!-- SPDX-License-Identifier: Apache-2.0 -->

PR Comparator

Compare PRs for one issue. Tier 0 determines eligibility. Tiers 1 and 2 score correctness and quality. Tier 3 resolves ties. If no PR passes Tier 0, rank eligible PRs for salvage.

Prerequisites

  • gh CLI installed and authenticated
  • A target repository with an issue that has two or more open PRs

Repo policy

The defaults use NemoClaw conventions for CODEOWNERS, DCO, CodeRabbit, and docs/. Read the canonical superseded-PR attribution policy in ../nemoclaw-maintainer-policies/references/workflow-policy.md. Edit repo-policy.md for another repository.

Execute comparator helpers from a fetched canonical NVIDIA/NemoClaw main checkout, or verify their executable code and dependencies against that revision before use. Candidate-modified helpers must not receive GitHub credentials. Inspect helper source when needed; a section heading does not establish trust.

Workflow

Step 1: Parse issue

Read the issue body and all comments. Extract each acceptance criterion:

gh issue view <issue-number> --json title,body,comments

Comments can add requirements that are absent from the issue body.

Step 2: Discover candidate PRs

scripts/find-candidates.sh <issue-number>

Applies a single default order with stop conditions.

Step 3: Detect supersession and transferred work

scripts/parse-supersession.sh <pr-number-1> <pr-number-2> ...

Parse the case-insensitive statement families implemented by scripts/parse-supersession.sh:

  • supersed[a-z]* before #N: supersedes #N points from the current PR to #N; superseded by #N points from #N to the current PR.
  • replac[a-z]* before #N: replaces #N points from the current PR to #N; replaced by #N points from #N to the current PR.
  • clos[a-z]* in favor of before #N: closes in favor of #N and closed in favor of #N point from #N to the current PR.
  • fold[a-z]* in before #N: folds in #N points from the current PR to #N; folded into #N points from #N to the current PR.

The bracket expressions describe the parser grammar; they are not literal PR body text. A follow-up to #N statement is a related-PR signal, not a supersession declaration, unless one of these phrases also appears. These statements record a relationship. They do not rank a candidate or prove that its diff contains another contributor's work.

For each declared or suspected replacement, compare the commits and diffs and classify the relationship:

  • independent: The PR implements the issue without carrying material code, tests, or documentation from another contributor.
  • transferred: The PR carries material work from another contributor.
  • unclear: The available evidence does not establish whether another contributor's work remains.

For transferred, apply the canonical superseded-PR attribution policy before setting a winner or recommending that the source PR be closed. For unclear, leave winner null and request maintainer judgment.

Step 4: Tier 0 gates

scripts/collect-gates.sh <pr-number>
scripts/check-coderabbit-threads.sh <pr-number>
git fetch --no-tags origin refs/heads/main:refs/remotes/origin/main
bash <(git show origin/main:.agents/skills/nemoclaw-maintainer-day/scripts/run-trusted-check-gates.sh) <pr-number>

All six gates are required. Gate 3 accepts BEHIND, but fails closed on transient UNSTABLE evidence and on BLOCKED because the comparator cannot prove a stable merge result or every GitHub branch-protection condition. Separately confirm whether an active rule requires an up-to-date branch. If so, integrate the base and rerun all candidate evidence before declaring the PR eligible to merge. Treat PR Review Advisor output as input for maintainer review. Do not treat it as merge authorization. See checks/tier-0-gates.md.

Step 5: Tier 1 correctness

Apply the six model checks in checks/tier-1-correctness.md.

Step 6: Tier 2 quality

Apply the four model checks in checks/tier-2-quality.md.

Step 7: Weighted score

  • Build the Tier 0 eligibility set from these Boolean keys: state_open, ci_green_sha, mergeable, contributor_compliance, branch_protection, and coderabbit_threads_resolved.
  • Stop if a candidate omits a required key, has an unknown key, or has a value that is not Boolean.
  • Only PRs for which all six gates are true enter happy-path scoring.
  • Each pass = full points
  • Each yellow = half points
  • Each fail = zero
  • Tier 1 weight: 2.0× per check
  • Tier 2 weight: 1.0× per check

Step 8: Tier 3 ranking

Compute the mode from the Tier 0 results. Do not accept a mode from the caller. In happy mode, set winner only to an eligible PR and set closest_to_ready to null. Leave winner null when the evidence does not support a merge recommendation. Do not set winner for a replacement with transferred work until the required attribution is present and verified. In degraded mode, set winner to null. Set closest_to_ready only to an open PR that passes contributor requirements. See tiebreakers.md.

Step 9: Emit verdict

Use templates/verdict.md and render the result with scripts/render-verdict.py. Stop if the renderer exits with a nonzero status. Do not recommend a merge. The renderer validates the gate schema, mode, winner eligibility, and salvage-candidate eligibility. The reviewer remains responsible for the score, ranking, and evidence. For each judgment, include evidence, the inference, and the score.

Reference files

Scripts

  • scripts/find-candidates.sh — PR discovery
  • scripts/collect-gates.sh — Tier 0 gate evaluation
  • scripts/check-coderabbit-threads.sh — GraphQL thread-resolution check
  • scripts/parse-supersession.sh — body parsing for supersession refs
  • scripts/render-verdict.py — verdict scorecard renderer

Limits

Run nemoclaw-maintainer-cross-issue-sweep separately when you need related-issue evidence.

This skill does not:

  • run PR code against adversarial inputs
  • scan other issues for related behavior
  • simulate reverts against related PRs
  • run static analyzers such as CodeQL or Semgrep

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Publish or update a NemoClaw pull request and track automated checks and reviews through completion. It preserves the requested scope, coordinates repairs for valid findings, and reports the latest commit’s results and remaining blockers.

  • Publishing implemented changes as a pull request
  • Updating an open pull request after review feedback
  • Tracking automated checks and reviews on the latest commit
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

Implement an accepted NemoClaw issue or repair a classified pull request finding. Keep changes within the agreed scope, run focused checks for affected behavior, and review the final changes before handing evidence to an authorized publication workflow.

  • Implement an accepted issue within its agreed scope
  • Repair a classified pull request finding
  • Validate failure, recovery, and cleanup behavior
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

Prepare a local NemoClaw development environment, repair setup problems, or check readiness. It also handles explicitly requested command-line access, runtime onboarding, and launching the coding agent pinned by the project.

  • Setting up a local NemoClaw development environment
  • Checking readiness before starting development
  • Repairing local dependency, build, or hook problems
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

Turn a named NemoClaw issue into an implementation plan with clear ownership, scope, completion criteria, and validation evidence. For larger changes, define independently useful steps, their dependencies, and delivery order.

  • Plan implementation for a named issue
  • Divide a large change into useful steps
  • Define acceptance criteria and test evidence
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

Audit and upgrade NemoClaw dependencies, including Hermes and base images. Trace upstream changes to affected code, implement required migrations, and verify tests, distributed artifacts, and the versions actually selected for use.

  • Assess the impact of a dependency upgrade
  • Plan migrations for a Hermes upgrade
  • Verify base images and selected artifacts
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

Update NemoClaw documentation after merged changes or audit it for outdated guidance. Verify current behavior against source and tests, edit the pages responsible for that guidance, and check affected links and generated variants.

  • Catch up documentation after merged changes
  • Audit documentation for outdated guidance
  • Update guides for changed user behavior
NVIDIA/NemoClaw22.8KUpdated Oct 22, 2026

See all skills by NVIDIA

Report a problem with this skill