SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding repo structure, (3) Preparing PRs for task submission.
The English summary is being prepared. Showing the original description.
See how to installReview the instructions the agent will receive before you install.
Benchmark evaluating how well AI agents use skills.
# 1. Install and initialize a task
# v1.1 docs target BenchFlow 0.6.2; uv installs the current stable CLI.
uv tool install benchflow
bench tasks init <task-id>
# 2. Write files (see CONTRIBUTING.md for templates)
# 3. Validate
bench tasks check tasks/my-task
bench eval run --tasks-dir tasks/my-task --agent oracle --sandbox docker # Must pass 100%
# 4. Test with agent (with skills)
bench eval run --tasks-dir tasks/my-task --agent claude-agent-acp \
--model <model> --skill-mode with-skill \
--skills-dir tasks/my-task/environment/skills/
# 5. Test WITHOUT skills
bench eval run --tasks-dir tasks/my-task --agent claude-agent-acp \
--model <model> --skill-mode no-skill
# 6. Submit PR (see PR template)
task.md prompt body and oracle/solve.sh must be human-authoredNo reviews yet. Tell others what you thought.
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
Perform various data analysis on SEC 13-F and obtain some insights of fund activities such as number of holdings, AUM, and change of holdings between two quarters.
The English summary is being prepared. Showing the original description.
AC branch pi-model power flow equations (P/Q and |S|) with transformer tap ratio and phase shift, matching `acopf-math-model.md` and MATPOWER branch fields. Use when computing branch flows in either direction, aggregating bus injections for nodal balance, checking MVA (rateA) limits, computing branch loading %, or debugging sign/units issues in AC power flow.
The English summary is being prepared. Showing the original description.
Redact text from PDF documents for blind review anonymization
The English summary is being prepared. Showing the original description.
Use when checking simplified ADA-derived plan-view bathroom accessibility constraints such as turning space, door clear width, toilet centerline, grab bars, and lavatory knee/toe clearance.
The English summary is being prepared. Showing the original description.
Analyze failed GitHub Action jobs for a pull request.
The English summary is being prepared. Showing the original description.
Use when extracting plan-view architectural geometry from DXF files with semantic CAD layers, especially when outputs must normalize rooms, doors, fixtures, clearances, and grab bars into machine-checkable JSON.
The English summary is being prepared. Showing the original description.