본문으로 건너뛰기
cccskills
무료GitHub에 공개

yolo-fb-gui-cli

YOLO + FB chooser (Frame B), Sapiens2 Pose, and GUI→CLI terminal mirror for vailá video-AI tools. Use when reopening Cursor CLI, wiring GUI buttons, printing copy-paste CLI from Tkinter runs, or continuing work on vaila.py yolotrackerpose / vaila_sam / vaila_sapiens / yolov26track / yolotrain.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

설치 방법 보기

포함된 파일(1)

  • SKILL.md6.9 KB

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

YOLO + FB Chooser & GUI→CLI Mirror (v0.3.91)

Use when the user works on Frame B → YOLO + FB, wants terminal commands equivalent to GUI clicks, or resumes after closing the terminal in Cursor CLI.

Companion docs:

  • docs/vaila_buttons/yolo-fb.md — chooser table + launcher CLI
  • AGENTS.md § Conventions (GUI→CLI mirror) + § History (v0.3.72, v0.3.76)
  • docs/sessions/2026-07-06-yolo-fb-gui-cli-mirror.md — implementation log
  • docs/sessions/2026-07-07-sapiens-output-dir-fix.md — one processed_sapiens_* per run (v0.3.76)
  • .claude/skills/sam3-video/SKILL.md — SAM 3 specifics
  • vaila/help/vaila_sapiens.md — Sapiens2 Pose

Chooser (vaila.py yolotrackerpose)

Button: Frame B B4_r4_c1 — YOLO + FB (was “Video AI tools” / “YOLO + SAM”).

Each chooser button calls _print_yolo_fb_launch() before launching the tool:

Chooser buttonLauncher CLI
Tracker (v26)uv run python -u -m vaila.yolov26track
Pose (video)in-process yolov26track.run_yolov26pose_video from main GUI
Pose (tracking)uv run python -u -m vaila.yolov26track + GUI ID picker
Seg (v26)same as Tracker; pick -seg.pt + seg run mode
SAM 3 videouv run python -u vaila/vaila_sam.py
Sapiens2 Poseuv run python -u vaila/vaila_sapiens.py
SAM3+Sapiens2uv run python -u vaila/sam3sapiens2.py
SAM3+Sapiens2 Visualize IDuv run python -u vaila/sam3sapiens2_visualize.py
Train YOLOv26uv run python -u -m vaila.yolotrain

GUI→CLI mirror convention

Rule: any module with a CLI must print copy-paste commands on GUI Run.

  • Prefix: >> (not [bracketed] — absl from mediapipe/opencv eats bracketed stdout)
  • Chooser: launcher only (_print_yolo_fb_launch in vaila.py)
  • Run: full args after user confirms dialogs
  • Highlight (v0.3.103+): the printed banner is bold-yellow ANSI on an interactive TTY (plain text when redirected/piped or NO_COLOR is set), via the shared vaila/cli_highlight.py module — print_gui_cli_mirror(module_label, cli) for a single reproducible command (banner + >> header + command line), or highlight(text) to wrap an individual line when a module prints a multi-line hint block instead of one clean command (e.g. yolov26track.py's Pose workflow hints, getpixelvideo.py's STOP/READ warnings). Every module below imports one or both of these instead of hand-rolling its own ANSI/print formatting — don't reintroduce a local duplicate.
ModuleHelperWhen printed
vaila_sam.py_build_sam_cli_argv, _print_sam_equivalent_cli (→ print_gui_cli_mirror)SAM GUI Run
vaila_sapiens.py_format_sapiens_cli_command, _print_sapiens_equivalent_cli (→ print_gui_cli_mirror)Sapiens2 GUI Run
sam3sapiens2.py_format_gui_cli → print_gui_cli_mirrorSAM3+Sapiens2 GUI Run
sam3dinov3.py_format_gui_cli → print_gui_cli_mirrorSAM3+DINOv3 3D GUI Run
sapiens2_3d.py_format_gui_cli → print_gui_cli_mirrorSapiens2 3D Pose GUI Run
reid_markers.pyrun_geometric_merge callers → print_gui_cli_mirrorCLI main() and GUI merge dialog
markerless_2d_analysis.pyinline → print_gui_cli_mirrorBatch GUI Run
markerless2d_analysis_v2.pyinline → print_gui_cli_mirrormain() when -i/-o given
rec3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
rec3d_one_dlt3d.pyinline → print_gui_cli_mirrorPreview + repeated after processing
blender_viz.pyformat_blender_viz_cli → print_gui_cli_mirrorAnimation Blender button
vaila_deadlift_imu.py_format_cli_command → highlight() per lineRun-configuration summary
yolov26track.py_format_track_cli_command → highlight() per lineTracker GUI before video loop (one track per file)
yolov26track.py_print_pose_video_equivalent_cli → highlight() per linePose (video) after config dialog
yolov26track.py_print_pose_from_tracking_workflow_hint → highlight() per linePose (tracking) after dir pick
yolotrain.py_format_training_cli_command, _print_gui_stateStart Training + GUI open
getpixelvideo.py>> Equivalent CLI blocks → highlight() per blockLoad Tracking CSV / save hints

Adding mirror to a new GUI module

try:
    from .cli_highlight import print_gui_cli_mirror
except ImportError:
    from cli_highlight import print_gui_cli_mirror  # ty: ignore[unresolved-import]

import shlex

def _format_my_cli_command(input_path: str, output: str, *, flag: int) -> list[str]:
    return ["uv", "run", "vaila/my_module.py", "-i", input_path, "-o", output, "--flag", str(flag)]

def _print_equivalent_cli(...) -> None:
    print_gui_cli_mirror("vaila/my_module", _format_my_cli_command(...))

print_gui_cli_mirror accepts either an argv list[str] (joined via shlex.join) or an already-formatted command string. Call it after dialogs OK, before long work.


Sapiens2 Pose (v0.3.71+)

uv sync --extra sapiens
bash bin/setup_sapiens2.sh   # clones .local/third_party/sapiens2/ + HF weights
uv run vaila/vaila_sapiens.py -i VIDEO_OR_DIR -o OUT_PARENT --model 1b
  • Default model 1b (RTX 4090 24 GiB)
  • CUDA only; Meta Sapiens2 License
  • One processed_sapiens_<timestamp>/ per run (v0.3.76); per-video subdirs <timestamp>/<stem>/
  • Isolated workers receive --output-base from parent — no empty duplicate folder
  • GUI→CLI mirror prints only -o (not --output-base); CLI creates processed_sapiens_<ts>/ under -o
  • Tests: uv run pytest tests/test_vaila_sapiens.py -v

Quick QA after changes

uv run ruff check vaila/vaila_sapiens.py vaila/vaila_sam.py vaila/yolov26track.py vaila.py --fix
uv run ruff format vaila/
uv run pytest tests/test_vaila_sapiens.py tests/test_vaila_sam.py::test_build_sam_cli_argv_includes_prompt tests/test_yolov26track_pose_reid.py::test_format_track_cli_command_maps_config -v

Cursor CLI resume checklist

  1. cd ~/data/vaila && uv sync (add --extra sam / --extra sapiens, or --no-group cpu --group cuda for NVIDIA, as needed)
  2. Read AGENTS.md History § v0.3.76 (Sapiens2 output dir) and this skill
  3. Global version: 0.3.91 (vaila.py header)
  4. Never rename chooser back to “Video AI tools” in docs — use YOLO + FB
  5. Visualize ID: CLI --id N or omit --id for interactive prompt; GUI uses combobox after browsing the run dir. Overlay = SAM3 contour fill + Sapiens2 left/right skeleton colors.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Configures best-practice alerting policies for AI agents using OpenTelemetry (OTel) metrics, generating output as Terraform (.tf) configuration files. Use when analyzing, writing, or deploying alerting policies to monitor agent latency, error rates, token usage, and quality metrics. Don't use for standard infrastructure monitoring unrelated to AI agents, or when the agent is not instrumented with OpenTelemetry (for Reliability, Cost, Safety, Security alerts). NOTE: Reliability, Cost, Safety, and Security alerts use generic OTel metrics and work across runtimes (such as Cloud Run, Vertex AI). Quality alerts rely on Vertex AI Online Monitors and are strictly bound to Vertex AI deployments.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

Deploy open models or custom weights from Model Garden to Agent Platform endpoints, check the status of an in-progress deployment operation, or clean up resources by undeploying models and deleting endpoints. Use when asked to actively deploy a model, list the Model Garden CATALOG of available models, check if a specific model is deployable (`gcloud ai model-garden models list-deployment-config`), query deployment cost, troubleshoot deployment errors (like quota limits), or undeploy/clean up endpoints. Also use when copying and deploying a 1P Tuned Model. Don't use for pure listing/discovery questions of the form "is X deployed?", "list my endpoints", or "which regions have models running?" — for those use `agent-platform-endpoint-management`. Don't use for public Vertex AI deployments (use the `vertex-deploy` skill) or for running model evaluations (use the `agent-platform-eval-flywheel` skill).

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

Manages Agent Platform serving endpoints. Use when you need to create, list, describe, update, or delete serving endpoints for model deployment on Agent Platform. Also use when troubleshooting endpoint permission, quota, or resource busy errors. Don't use for deploying models to endpoints or for running model evaluations.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama, DeepSeek, Qwen, etc.). Use when asked to perform inference, ask a model a question, run a test prompt, execute chat completions, or generate code for calling Gemini or OpenMaaS models, authenticate with GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK, configure base URLs and global/regional endpoints, or troubleshoot 429 Resource Exhausted (DSQ), 400 User Validation, or 404 Not Found errors. Don't use for deploying models to endpoints or for running model evaluations.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

Guides agents and users through migrating from Gemini API in Google AI Studio to Gemini Enterprise Agent Platform (formerly Vertex AI). Use this skill when moving applications to Google Cloud, to leverage Cloud credits, or to unify inferencing with other Cloud infrastructure (IAM, billing, telemetry).

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

vaila-multimodaltoolbox/vaila212026년 10월 20일 업데이트

vaila-multimodaltoolbox의 스킬 모두 보기

이 스킬의 문제 신고