Trace failing cmux Swift package tests to the commits that introduced them by running older revisions in CI, the automated testing environment. It helps distinguish outdated expectations, code regressions, and intermittent failures, then guides focused fixes and verification.
- Investigating a package suite failing on main
- Finding the PR that first broke a test
- Distinguishing outdated tests from code regressions
manaflow-ai/cmux☆ 28.3KUpdated Oct 20, 2026
Write regression tests that catch recurring bugs in FastMCP changes using pytest. Covers reproducing failures before a fix, testing requests without a network server, and checking outgoing requests while replacing external services with test substitutes.
- Reproducing a bug before testing its fix
- Testing MCP behavior without a network server
- Checking requests sent to external services
PrefectHQ/fastmcp☆ 28.2KUpdated Oct 21, 2026
Add Storybook stories, examples of component states, for the Kilo VS Code extension UI. The existing Playwright runner turns them into screenshot comparisons to check visual changes across states and widths.
- Add screenshot coverage for chat or settings screens
- Check layouts at 420px and 200px widths
- Show permission requests using mock data
Kilo-Org/kilocode☆ 27.7KUpdated Oct 20, 2026
Refine a game feature or area through performance measurement, visual and audio polish, and stress and regression testing. Report before-and-after metrics, remaining issues, and release readiness, with work limited to the enabled team roles.
- Identify performance bottlenecks in combat
- Refine particle effects and shaders
- Review sound feedback and audio mixing
Donchitos/Claude-Code-Game-Studios☆ 27KUpdated Oct 19, 2026
Build Handsontable demo pages for visual regression tests, which compare screenshots for appearance changes. It guides feature routes, URL-driven display states, sample data, and decisions about testing the same feature across framework wrappers.
- Adding a demo route for a new feature
- Creating multiple visual states through URL parameters
- Planning visual coverage across framework wrappers
handsontable/handsontable☆ 22.1KUpdated Oct 21, 2026
Review Apache ShardingSphere pull requests or authorized downstream changes using repository evidence. Assess code correctness, merge readiness, or CI failures, then produce consolidated findings or a ready-to-copy reply to a review discussion.
- Review code changes for correctness and regression risks
- Assess whether a pull request is ready to merge
- Investigate CI failures
apache/shardingsphere☆ 20.8KUpdated Oct 21, 2026
Evaluate AI agent outputs with code checks and model-based grading. Run repeated trials to measure reliability, compare prompts or models, and check whether changes reduce quality, with saved transcripts for reviewing the results.
- Comparing two prompts on the same test cases
- Checking quality after agent configuration changes
- Turning real failures into repeatable evaluation cases
danielmiessler/LifeOS☆ 19.5KUpdated Sep 4, 2026
Save a page's SEO settings and compare them with later versions to detect changes after updates or deployments. Review differences in titles, headings, indexing controls, structured data, and available performance metrics, with severity levels and stored comparison history.
- Compare SEO settings before and after deployment
- Check for unintended title or heading changes
- Investigate page changes after a traffic drop
AgriciDaniel/claude-seo☆ 19.5KUpdated Oct 5, 2026
Implement an authorized fix for a reviewed security issue, check the plan against current code, and add regression tests to catch recurrence. Verify affected components and open a pull request that closes the issue while respecting disclosure rules.
- Implementing an approved security remediation plan
- Rechecking a reviewed fix against current code
- Adding regression tests for a security boundary
NVIDIA/OpenShell☆ 16.9KUpdated Oct 21, 2026
Triage incorrect MNN outputs and regressions by matching symptoms to focused debugging guides. Use backend comparisons, minimal reproductions, and controlled experiments to investigate memory issues, quantization, concurrency, numeric limits, caches, and inconsistent results across runs.
- Investigating garbled or degraded MNN output
- Comparing results across execution backends
- Tracking regressions after optimization changes
alibaba/MNN☆ 16.3KUpdated Oct 21, 2026
Analyze failures in CI, the automated checks run during development. Identify the failing job and step, classify the likely cause, and suggest a small fix, continued monitoring, or human review.
- Identifying failed jobs and steps in CI
- Distinguishing intermittent failures from code regressions
- Routing environment failures to a human
cobusgreyling/loop-engineering☆ 11.6KUpdated Oct 20, 2026
Official · CodexFreeSummary Assess a fixed patch or pull request diff before merging. Trace affected behavior, evaluate regression risks, tests, and recovery options, then provide an evidence-based recommendation and advisory automatic-merge eligibility without modifying or merging the patch.
- Assess a generated patch before merging
- Trace how a pull request affects production behavior
- Evaluate tests and rollback options
openai/codex-security☆ 11.1KUpdated Oct 20, 2026
Investigate a bug's root cause, implement a focused repair, and verify the same behavior before and after the change. Select lasting regression tests, preserve reproduction evidence, and record the corrected user journey when possible.
- Investigating and fixing a bug without an existing candidate PR
- Proving a repair with failing-then-passing tests
- Consolidating regression checks into existing tests
omnigent-ai/omnigent☆ 10.9KUpdated Oct 20, 2026
Investigate Bifrost GitHub issues by examining reports, related code, and library documentation. Produce an implementation plan with impact analysis and regression tests, including a demonstrated failing test for bugs before requesting approval to fix them.
- Investigating the cause of a reported bug
- Planning implementation for a feature request
- Assessing effects on APIs, UI, and dependent code
maximhq/bifrost☆ 9KUpdated Oct 20, 2026
Review a branch, pull request, or uncommitted changes for interface problems involving accessibility, layout, text, typography, and color. The report distinguishes newly introduced issues, regressions, and existing problems, including effects on screens that use changed components.
- Review interface changes in a pull request
- Check whether shared component changes affect other screens
- Find accessibility regressions before merging
jakubkrehel/skills☆ 8.1KUpdated Oct 13, 2026
Handle one known local bug or testable bug hypothesis through reproduction, independent validation, repair, and regression checks. Produce a local patch commit and evidence reports that help reviewers judge whether the fix is ready.
- Investigate and repair one reported local bug
- Have separate agents verify reproduction and the fix
- Prepare evidence reports for patch review
trailofbits/skills☆ 7.7KUpdated Oct 21, 2026
Build and run systems before and after a change, then execute the same reproduction procedure against both. Save environment details, inputs, commands, and separate logs to document observed behavior and any setup blockers.
- Compare behavior before and after a change
- Create a portable procedure to reproduce a suspected defect
- Record environments, commands, and execution logs
trailofbits/skills☆ 7.7KUpdated Oct 21, 2026
Compares code relationships before and after a branch, pull request, or release change using Trailmark. Flags structural security regressions, such as removed authorization checks or newly reachable sensitive operations, and provides evidence for reviewers.
- Checking structural security changes before merging a PR
- Reviewing call paths after a security fix
- Assessing attack surface changes in a release
trailofbits/skills☆ 7.7KUpdated Oct 21, 2026
Validate security patches by comparing vulnerable and patched code against exploit tests, related attack variants, and normal behavior. Produce reproducible logs showing remaining flaws, regressions, newly introduced security failures, and gaps that still need testing.
- Validate an AI-generated security patch before review
- Check related attack variants for incomplete fixes
- Check whether a fix breaks normal behavior
trailofbits/skills☆ 7.7KUpdated Oct 21, 2026
Official · CodexFreeSummary Assess a fixed code patch for behavior changes, regression risks, test coverage, and recovery options. Receive an evidence-based report and structured assessment indicating whether it is ready to merge and qualifies as an automatic merge candidate.
- Reviewing the risks of an AI-generated patch
- Checking affected behavior before merging a pull request
- Assessing whether tests protect changed behavior
openai/plugins☆ 7.5KUpdated Oct 8, 2026
Review Python changes against shared team standards to find bugs, missing regression tests, and security issues. Findings are ordered by severity and include file names and line numbers so reviewers can locate each problem.
- Reviewing Python changes before merging
- Checking that bug fixes include regression tests
- Finding unsafe SQL and exposed secrets
kyegomez/swarms☆ 7.3KUpdated Oct 20, 2026
Compare Sentry issues across selected time windows and releases to find new or recurring problems and changes in frequency or affected users. Prioritize findings using user impact and the strength of available evidence.
- Compare issues before and after a release
- Find recurring issues and frequency changes
- Prioritize issues by affected users
Devin-AXIS/iPolloWork☆ 7.1KUpdated Oct 20, 2026
Test browser games through repeatable game states and short real playthroughs. Check controls, progression, saves, device layouts, and visible feedback, then report bugs with reproduction steps, severity, and browser evidence.
- Gameplay checks before release
- Regression testing after game updates
- Touch controls and mobile layout checks
MengTo/Skills☆ 6.9KUpdated Oct 18, 2026
Implement and tune Three.js game cameras so players, threats, and objectives stay readable. Covers smooth following, isometric views, zoom and orbit limits, obstruction handling, target lock-on, camera shake, touch controls, and checks for regressions.
- Tuning follow cameras and isometric framing
- Keeping players visible around walls and tall props
- Adding lock-on behavior and temporary camera shake
MengTo/Skills☆ 6.9KUpdated Oct 18, 2026