Skip to content
cccskills
FreePublished on GitHub

evosearch

Run the CaP Fix Loop + Evolutionary Search experiment on a user-supplied list of low-performing benchmark tasks: iterative K=8 candidate search on development seeds 51–65, validation selection, and final held-out evaluation on seeds 1–50.

The English summary is being prepared. Showing the original description.

NVlabs/ASPIRE887 stars(GitHub 887 + cccskills 0)

Run score Not tested

See how to install

Files included (8)

  • SKILL.md3.1 KB
  • clean-task-slate.md981 B
  • main-agent-prompt.md5.9 KB
  • scripts/analyze_evosearch_traces.py9.1 KB
  • scripts/evosearch_eval.py13.1 KB
  • skills/evosearch-iteration.md26.9 KB
  • skills/README.md360 B
  • subagent-prompt.md16.7 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Fix Loop + Evolutionary Search

Use this skill for intensive debugging of difficult tasks — Evolutionary Search's multi-candidate search finds strategies the single-pass fix loop misses. It builds on the iterative-debugging skill: each task's fix loop fix_code.py (when present) is the baseline to beat, seeded verbatim as candidate_A. LIBERO-Pro runs use --init-mode seeded so development seeds 51–65 and held-out seeds 1–50 are distinct scenes.

Setup

  1. Complete benchmark setup for the target embodiment (docs/libero-pro.md, or docs/robosuite.md), including the pinned environment (for LIBERO: scripts/bootstrap_libero.sh → .venv-libero) and SAM3 authentication.
  2. Export the benchmark environment variables (for LIBERO: LIBERO_CONFIG_PATH="$PWD/.libero", MUJOCO_GL=egl, PYOPENGL_PLATFORM=egl, EGL_PLATFORM=device, TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1).
  3. Start perception services (scripts/supervise_services.sh) and a persistent coordinator session.
  4. Confirm the Fix Loop experiment has produced fix_code.py (and a baseline held-out rate) for the target tasks when available.
  5. Read docs/api-reference.md, docs/run-artifacts.md, and main-agent-prompt.md.

Run Order

  1. Take the task list from the user (tasks below the success threshold; any set of (benchmark, suite, task_id) cases) and follow main-agent-prompt.md as the coordinator.
  2. Fill subagent-prompt.md once per task and dispatch subagents on the available worker GPUs.
  3. Subagents read the experiment-specific companion skills under skills/ when generating candidates, iterate with scripts/evosearch_eval.py, and run the Stage 2 held-out evaluation themselves with the shared .claude/skills/iterative-debugging/scripts/run_validation.py before returning.
  4. Use clean-task-slate.md before rerunning a task or suite.

Files

FilePurpose
main-agent-prompt.mdCoordinator runbook for task dispatch and result collection
subagent-prompt.mdPer-task Evolutionary Search iteration prompt
clean-task-slate.mdReset checklist before reruns
skills/evosearch-iteration.mdCandidate/eval/keyframe iteration mechanics
scripts/evosearch_eval.pyCandidate × seed matrix evaluator
scripts/analyze_evosearch_traces.pyPost-eval per-candidate signal analysis
docs/api-reference.mdPublic CaP program API reference
../iterative-debugging/skills/Shared robot skills (localize/grasp/transport/manipulation)

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Localize objects and compose low-level CAP MCP actions using observations, Cartesian or synchronized motion, joint targets, and single-arm gripper control.

The English summary is being prepared. Showing the original description.

NVlabs/ASPIRE887Updated Oct 16, 2026

Run the baseline-free CaP iterative debugging (fix loop) pipeline on a user-supplied list of benchmark tasks: inspect one initial observed scene per task, generate task-level code, debug failures on development seeds using recorded run artifacts, validate on the held-out partition, grade the skill library against what actually worked, and promote only those patterns a verifier could reproduce the fix from.

The English summary is being prepared. Showing the original description.

NVlabs/ASPIRE887Updated Oct 16, 2026

Block-by-block fix loop on BEHAVIOR-1K (R1 Pro, OmniGibson on Isaac Sim). The policy is grown one code block at a time against what the robot actually did, and what carries across seeds is a skill library, not a program. Use for the two R1 Pro pickup tasks; Stage 1 learns on seeds 26-35, Stage 2 evaluates on 1-25 with a frozen library.

The English summary is being prepared. Showing the original description.

NVlabs/ASPIRE887Updated Oct 16, 2026

Perform task-specific real YAM manipulation with native CAP tools. Use for solving or turning a physical Rubik's Cube, bottle-cap removal and pouring, pill insertion and bottle closure, or inverted cup nesting.

The English summary is being prepared. Showing the original description.

NVlabs/ASPIRE887Updated Oct 16, 2026

See all skills by NVlabs

Report a problem with this skill