跳到正文
cccskills
免费在 GitHub 公开

iterative-debugging-behavior

Block-by-block fix loop on BEHAVIOR-1K (R1 Pro, OmniGibson on Isaac Sim). The policy is grown one code block at a time against what the robot actually did, and what carries across seeds is a skill library, not a program. Use for the two R1 Pro pickup tasks; Stage 1 learns on seeds 26-35, Stage 2 evaluates on 1-25 with a frozen library.

中文简介正在准备中。当前显示原文说明。

NVlabs/ASPIRE星标 887(GitHub 887 + cccskills 0)

实测评分 未实测

查看安装方法

包含的文件(11)

  • SKILL.md7.6 KB
  • clean-task-slate.md1.6 KB
  • main-agent-prompt.md10.0 KB
  • score_campaign.py6.7 KB
  • skills/isaac-operations.md3.3 KB
  • skills/mobile-grasp.md4.5 KB
  • skills/navigation.md3.7 KB
  • skills/README.md1.8 KB
  • skills/search.md3.3 KB
  • skills/time-budget.md1.7 KB
  • subagent-prompt.md32.1 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Block-by-Block Fix Loop on BEHAVIOR-1K

The parent skill (../SKILL.md) writes one whole program per task, freezes it, and replays that frozen program across the held-out seeds. That protocol does not apply here. BEHAVIOR tasks are long-horizon: the robot starts in another room, cannot see the target, and must search, drive, look down and grasp. A program authored up front is guessing at every stage past the first.

So on this benchmark the policy is grown, not authored:

  1. Write one # Code block N section.
  2. Run the whole policy.py on the seed, from a fresh reset.
  3. Read what actually happened: where the base ended up, what was localized, what the hand holds.
  4. Write the next block against that observed state, and run the whole program again.
  5. Repeat until the seed succeeds or the budget is spent.

The simulator resets on every attempt. Only policy.py persists and accumulates blocks.

What carries across seeds is the skill library, not any policy. Each seed's policy.py is disposable. Stage 2 measures whether the frozen library is enough for a fresh agent to solve an unseen seed, not whether one program generalizes.

The library is shared by both tasks. It lives at $RUN_ROOT/behavior/skill-library/, above the suite directories, and a task's Stage 1 extends what the previous task left. This is a deliberate departure from ASPIRE, which keeps one library per task. The reason is that most of what a campaign learns here is about the harness, the robot and the simulator rather than about one object, and re-discovering it per task wastes a bootstrap seed each time. It also asks a more interesting question: does a library built on one task help on a different one.

It leaks nothing, because the partition is per task. Knowledge measured on the radio's seeds says nothing about a soda-can instance, so the can's evaluation seeds stay unseen.

The cost is that every entry must carry the task it was measured on, and an entry from another task is a hypothesis rather than a rule until this task's seeds confirm it.

Difference from the parentConsequence
Long horizon, target not visible at resetBlocks are written against observed state, never predicted state
The deliverable is a libraryStage 1 promotes skills after every seed; policies are disposable
Stage 2 is agenticA fresh agent per evaluation seed writes its own blocks against the frozen library
Frames: odom is fixed where the base stood at resetLocalized objects stay valid after the base drives
Episodes cost minutes, not secondsEvery attempt replays every earlier block; keep blocks lean
Isaac Sim, not MuJoCoOMNIGIBSON_* variables, one Isaac process per GPU, exit 139 after a complete run is normal, judge by outcome.json
Planning runs in-process on cuRoboMotionStrategy() already means cuRobo; PyRoKi and port 8118 are not involved
Two arms, a torso and a basebehavior.* extensions move base and torso; RobotAction moves arms

Setup

  1. scripts/bootstrap_behavior.sh --accept-dataset-tos once per machine (see docs/behavior.md); it prints the activation block.
  2. Export the Benchmark Profile block from subagent-prompt.md verbatim in every shell that runs episodes. It sets CAP_HARNESS, SERVICE_PORTS, the OMNIGIBSON_* variables, CUDA_VISIBLE_DEVICES and ulimit -c 0. Run flags are spelled out in the run command rather than held in a variable, because zsh does not word-split one.
  3. Bootstrap the two provider venvs once (scripts/bootstrap_providers.sh --providers sam3,contact_graspnet --profile rtx4090; profiles live in configs/profiles/), then start them: scripts/supervise_services.sh --providers sam3,contact_graspnet --profile rtx4090. On a single-GPU bench they share the card with Isaac (about 8 GB of VRAM together); leave PyRoKi and cuRobo services down, they are not used.
  4. Read docs/api-reference.md (the behavior.* rows), docs/behavior.md ## Semantics (the odom paragraph), docs/run-artifacts.md, and main-agent-prompt.md.

Seeds

Seeds are task-instance ids; both tasks ship 300 training instances (0-299), so every partition below is valid without any init-mode switch.

PartitionSeedsRule
Stage 1, learning26-35Build the skill library here. Never inspect an evaluation seed.
Stage 2, evaluation1-25One fresh agent per seed, empty policy, frozen library, append-only.
Free diagnostics36-50One-off probes only; never reported.

The shipped examples under examples/behavior/ were verified on seeds 1-3, which are evaluation seeds. They are API documentation, not campaign material: a campaign never reads them, and the skill library starts empty.

Campaign Layout

$RUN_ROOT/behavior/
├── skill-library/               # SHARED and cumulative across both tasks
└── <suite>/
├── campaign-state.md            # coordinator's ledger: seed, stage, attempts, outcome
├── skill-library-frozen/        # this task's read-only snapshot, taken at its freeze
├── frozen-manifest.sha256
├── stage1/seed_26 … seed_35/
│   ├── policy.py                # grows block by block
│   ├── attempts/attempt_001/ …  # one harness run directory per attempt
│   └── seed-summary.md
└── stage2/seed_01 … seed_25/    # same shape, frozen library, fresh agent each

Run Order

  1. Create the layout above for the suite you are running. If this is the first task of a campaign, seed the shared skill-library/ with the topic files from skills/ as templates only, headings without contents. If a previous task has already run, the shared library is what it left: use it as it stands, and do not reset it.
  2. Stage 1: for each seed 26 to 35 in order, dispatch one worker with subagent-prompt.md at STAGE: 1. After each seed, fold what worked into skill-library/ and record the seed in campaign-state.md.
  3. Freeze after seed 35, following main-agent-prompt.md. Nothing in the library, the prompts, the config or the protocol changes after this point.
  4. Stage 2: for each seed 1 to 25, dispatch one fresh worker at STAGE: 2 with the frozen library. No information passes between evaluation seeds.
  5. Score with ./score_campaign.py <campaign-dir>. Do NOT hand-count attempts: the unit of scoring is the final policy, and the script finds it by hashing each run's source/program.py. Exactly two numbers are reported, both per seed: success, the seed's final policy succeeded at least once; and navigation, the seed's final policy reached the object. Reliability is not reported. Development attempts ran earlier programs with no grasp block and are excluded entirely. See Scoring in main-agent-prompt.md.
  6. Use clean-task-slate.md before reruns.
  7. Promote findings into this folder's skills/ files only between campaigns, never during Stage 2.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Localize objects and compose low-level CAP MCP actions using observations, Cartesian or synchronized motion, joint targets, and single-arm gripper control.

中文简介正在准备中。当前显示原文说明。

NVlabs/ASPIRE8872026年10月16日 更新

evosearch

免费

Run the CaP Fix Loop + Evolutionary Search experiment on a user-supplied list of low-performing benchmark tasks: iterative K=8 candidate search on development seeds 51–65, validation selection, and final held-out evaluation on seeds 1–50.

中文简介正在准备中。当前显示原文说明。

NVlabs/ASPIRE8872026年10月16日 更新

Run the baseline-free CaP iterative debugging (fix loop) pipeline on a user-supplied list of benchmark tasks: inspect one initial observed scene per task, generate task-level code, debug failures on development seeds using recorded run artifacts, validate on the held-out partition, grade the skill library against what actually worked, and promote only those patterns a verifier could reproduce the fix from.

中文简介正在准备中。当前显示原文说明。

NVlabs/ASPIRE8872026年10月16日 更新

Perform task-specific real YAM manipulation with native CAP tools. Use for solving or turning a physical Rubik's Cube, bottle-cap removal and pouring, pill insertion and bottle closure, or inverted cup nesting.

中文简介正在准备中。当前显示原文说明。

NVlabs/ASPIRE8872026年10月16日 更新

查看 NVlabs 的全部技能

报告此技能的问题