跳到正文
cccskills
免费在 GitHub 公开

yolo-fb-gui-cli

YOLO + FB chooser (Frame B), Sapiens2 Pose, and GUI→CLI terminal mirror for vailá video-AI tools. Use when reopening Cursor CLI, wiring GUI buttons, printing copy-paste CLI from Tkinter runs, or continuing work on vaila.py yolotrackerpose / vaila_sam / vaila_sapiens / yolov26track / yolotrain.

中文简介正在准备中。当前显示原文说明。

查看安装方法

包含的文件(1)

  • SKILL.md6.9 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

YOLO + FB Chooser & GUI→CLI Mirror (v0.3.91)

Use when the user works on Frame B → YOLO + FB, wants terminal commands equivalent to GUI clicks, or resumes after closing the terminal in Cursor CLI.

Companion docs:

  • docs/vaila_buttons/yolo-fb.md — chooser table + launcher CLI
  • AGENTS.md § Conventions (GUI→CLI mirror) + § History (v0.3.72, v0.3.76)
  • docs/sessions/2026-07-06-yolo-fb-gui-cli-mirror.md — implementation log
  • docs/sessions/2026-07-07-sapiens-output-dir-fix.md — one processed_sapiens_* per run (v0.3.76)
  • .claude/skills/sam3-video/SKILL.md — SAM 3 specifics
  • vaila/help/vaila_sapiens.md — Sapiens2 Pose

Chooser (vaila.py yolotrackerpose)

Button: Frame B B4_r4_c1 — YOLO + FB (was “Video AI tools” / “YOLO + SAM”).

Each chooser button calls _print_yolo_fb_launch() before launching the tool:

Chooser buttonLauncher CLI
Tracker (v26)uv run python -u -m vaila.yolov26track
Pose (video)in-process yolov26track.run_yolov26pose_video from main GUI
Pose (tracking)uv run python -u -m vaila.yolov26track + GUI ID picker
Seg (v26)same as Tracker; pick -seg.pt + seg run mode
SAM 3 videouv run python -u vaila/vaila_sam.py
Sapiens2 Poseuv run python -u vaila/vaila_sapiens.py
SAM3+Sapiens2uv run python -u vaila/sam3sapiens2.py
SAM3+Sapiens2 Visualize IDuv run python -u vaila/sam3sapiens2_visualize.py
Train YOLOv26uv run python -u -m vaila.yolotrain

GUI→CLI mirror convention

Rule: any module with a CLI must print copy-paste commands on GUI Run.

  • Prefix: >> (not [bracketed] — absl from mediapipe/opencv eats bracketed stdout)
  • Chooser: launcher only (_print_yolo_fb_launch in vaila.py)
  • Run: full args after user confirms dialogs
  • Highlight (v0.3.103+): the printed banner is bold-yellow ANSI on an interactive TTY (plain text when redirected/piped or NO_COLOR is set), via the shared vaila/cli_highlight.py module — print_gui_cli_mirror(module_label, cli) for a single reproducible command (banner + >> header + command line), or highlight(text) to wrap an individual line when a module prints a multi-line hint block instead of one clean command (e.g. yolov26track.py's Pose workflow hints, getpixelvideo.py's STOP/READ warnings). Every module below imports one or both of these instead of hand-rolling its own ANSI/print formatting — don't reintroduce a local duplicate.
ModuleHelperWhen printed
vaila_sam.py_build_sam_cli_argv, _print_sam_equivalent_cli (→ print_gui_cli_mirror)SAM GUI Run
vaila_sapiens.py_format_sapiens_cli_command, _print_sapiens_equivalent_cli (→ print_gui_cli_mirror)Sapiens2 GUI Run
sam3sapiens2.py_format_gui_cli → print_gui_cli_mirrorSAM3+Sapiens2 GUI Run
sam3dinov3.py_format_gui_cli → print_gui_cli_mirrorSAM3+DINOv3 3D GUI Run
sapiens2_3d.py_format_gui_cli → print_gui_cli_mirrorSapiens2 3D Pose GUI Run
reid_markers.pyrun_geometric_merge callers → print_gui_cli_mirrorCLI main() and GUI merge dialog
markerless_2d_analysis.pyinline → print_gui_cli_mirrorBatch GUI Run
markerless2d_analysis_v2.pyinline → print_gui_cli_mirrormain() when -i/-o given
rec3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
rec3d_one_dlt3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
blender_viz.pyformat_blender_viz_cli → print_gui_cli_mirrorAnimation Blender button
vaila_deadlift_imu.py_format_cli_command → highlight() per lineRun-configuration summary
yolov26track.py_format_track_cli_command → highlight() per lineTracker GUI before video loop (one track per file)
yolov26track.py_print_pose_video_equivalent_cli → highlight() per linePose (video) after config dialog
yolov26track.py_print_pose_from_tracking_workflow_hint → highlight() per linePose (tracking) after dir pick
yolotrain.py_format_training_cli_command, _print_gui_stateStart Training + GUI open
getpixelvideo.py>> Equivalent CLI blocks → highlight() per blockLoad Tracking CSV / save hints

Adding mirror to a new GUI module

try:
    from .cli_highlight import print_gui_cli_mirror
except ImportError:
    from cli_highlight import print_gui_cli_mirror  # ty: ignore[unresolved-import]

import shlex

def _format_my_cli_command(input_path: str, output: str, *, flag: int) -> list[str]:
    return ["uv", "run", "vaila/my_module.py", "-i", input_path, "-o", output, "--flag", str(flag)]

def _print_equivalent_cli(...) -> None:
    print_gui_cli_mirror("vaila/my_module", _format_my_cli_command(...))

print_gui_cli_mirror accepts either an argv list[str] (joined via shlex.join) or an already-formatted command string. Call it after dialogs OK, before long work.


Sapiens2 Pose (v0.3.71+)

uv sync --extra sapiens
bash bin/setup_sapiens2.sh   # clones .local/third_party/sapiens2/ + HF weights
uv run vaila/vaila_sapiens.py -i VIDEO_OR_DIR -o OUT_PARENT --model 1b
  • Default model 1b (RTX 4090 24 GiB)
  • CUDA only; Meta Sapiens2 License
  • One processed_sapiens_<timestamp>/ per run (v0.3.76); per-video subdirs <timestamp>/<stem>/
  • Isolated workers receive --output-base from parent — no empty duplicate folder
  • GUI→CLI mirror prints only -o (not --output-base); CLI creates processed_sapiens_<ts>/ under -o
  • Tests: uv run pytest tests/test_vaila_sapiens.py -v

Quick QA after changes

uv run ruff check vaila/vaila_sapiens.py vaila/vaila_sam.py vaila/yolov26track.py vaila.py --fix
uv run ruff format vaila/
uv run pytest tests/test_vaila_sapiens.py tests/test_vaila_sam.py::test_build_sam_cli_argv_includes_prompt tests/test_yolov26track_pose_reid.py::test_format_track_cli_command_maps_config -v

Cursor CLI resume checklist

  1. cd ~/data/vaila && uv sync (add --extra sam / --extra sapiens, or --no-group cpu --group cuda for NVIDIA, as needed)
  2. Read AGENTS.md History § v0.3.76 (Sapiens2 output dir) and this skill
  3. Global version: 0.3.91 (vaila.py header)
  4. Never rename chooser back to “Video AI tools” in docs — use YOLO + FB
  5. Visualize ID: CLI --id N or omit --id for interactive prompt; GUI uses combobox after browsing the run dir. Overlay = SAM3 contour fill + Sapiens2 left/right skeleton colors.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Configures best-practice alerting policies for AI agents using OpenTelemetry (OTel) metrics, generating output as Terraform (.tf) configuration files. Use when analyzing, writing, or deploying alerting policies to monitor agent latency, error rates, token usage, and quality metrics. Don't use for standard infrastructure monitoring unrelated to AI agents, or when the agent is not instrumented with OpenTelemetry (for Reliability, Cost, Safety, Security alerts). NOTE: Reliability, Cost, Safety, and Security alerts use generic OTel metrics and work across runtimes (such as Cloud Run, Vertex AI). Quality alerts rely on Vertex AI Online Monitors and are strictly bound to Vertex AI deployments.

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

Deploy open models or custom weights from Model Garden to Agent Platform endpoints, check the status of an in-progress deployment operation, or clean up resources by undeploying models and deleting endpoints. Use when asked to actively deploy a model, list the Model Garden CATALOG of available models, check if a specific model is deployable (`gcloud ai model-garden models list-deployment-config`), query deployment cost, troubleshoot deployment errors (like quota limits), or undeploy/clean up endpoints. Also use when copying and deploying a 1P Tuned Model. Don't use for pure listing/discovery questions of the form "is X deployed?", "list my endpoints", or "which regions have models running?" — for those use `agent-platform-endpoint-management`. Don't use for public Vertex AI deployments (use the `vertex-deploy` skill) or for running model evaluations (use the `agent-platform-eval-flywheel` skill).

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

Manages Agent Platform serving endpoints. Use when you need to create, list, describe, update, or delete serving endpoints for model deployment on Agent Platform. Also use when troubleshooting endpoint permission, quota, or resource busy errors. Don't use for deploying models to endpoints or for running model evaluations.

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama, DeepSeek, Qwen, etc.). Use when asked to perform inference, ask a model a question, run a test prompt, execute chat completions, or generate code for calling Gemini or OpenMaaS models, authenticate with GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK, configure base URLs and global/regional endpoints, or troubleshoot 429 Resource Exhausted (DSQ), 400 User Validation, or 404 Not Found errors. Don't use for deploying models to endpoints or for running model evaluations.

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

Guides agents and users through migrating from Gemini API in Google AI Studio to Gemini Enterprise Agent Platform (formerly Vertex AI). Use this skill when moving applications to Google Cloud, to leverage Cloud credits, or to unify inferencing with other Cloud infrastructure (IAM, billing, telemetry).

中文简介正在准备中。当前显示原文说明。

vaila-multimodaltoolbox/vaila212026年10月20日 更新

查看 vaila-multimodaltoolbox 的全部技能

报告此技能的问题