本文へ移動
cccskills
無料GitHub で公開

quality-engineering-automation-health

Measures whether an automation suite builds release confidence via feedback-loop length, suite reliability, release cadence, and production escape rate, and emits a release_confidence verdict. Use when judging suite value, ROI, or pre-release trust; not for writing or healing tests.

インストール方法を見る

含まれるファイル(4)

  • SKILL.md3.4 KB
  • evals/evals.json2.2 KB
  • references/confidence-report-template.md764 B
  • references/metrics-definitions.md2.9 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Quality Engineering: Automation Health

Priority: P1 (HIGH)

Mission

Automation exists to reduce ambiguity at release time, not to catch every bug. Finding bugs is testing's job; building confidence is automation's. Judge a suite by whether the team can deploy on Friday afternoon without fear.

Three Questions

A high-value suite answers all three with evidence:

  1. Core workflows intact: the flows that create revenue and user value still run end to end.
  2. No serious regression: the latest change did not break what was already stable.
  3. Fast feedback: a developer learns what they broke in minutes, not hours.

Four Metrics

MetricKeyQuestion it answers
Feedback loopfeedback_loop_minutesHow long from push to a trusted green or red?
Suite reliabilitysuite_reliability_pctWhen a run is red, does the team investigate or just re-run?
Release cadencerelease_cadenceDid automation let the team ship more often without more production risk?
Production escape rateprod_escape_rateHow many serious defects passed the whole pipeline and reached real users?

Formulas and data sources per CI provider live in Metrics Definitions.

Verdict

release_confidence: high | medium | low

  • high: all three questions answered yes with evidence; reliability at or above the team threshold; escape rate at or below baseline; feedback loop within target.
  • medium: one question lacks evidence, or reliability or feedback loop misses target while escapes stay at baseline.
  • low: any question answered no, a red run is not trusted, or escape rate rose after the last release.

Report with Confidence Report Template; feed release_confidence into test-loop, uat-signoff, and deploy-release handoffs.

Anti-Patterns

  • No ranking by bug count: a suite that catches few bugs on CI usually means developers catch them locally first; that is success, not waste.
  • No deleting never-failing tests: a test that never fails is a safety net, not dead weight. It is what lets engineers refactor, bump dependencies, and change config without silent breakage.
  • No coverage % as the goal: coverage measures lines touched, not confidence earned.
  • No pass rate as health: a 99% pass rate with untrusted reds is worse than 95% the team believes.

Red Flags

"this test never fails, delete it" · "just re-run it, it's probably flaky" · "we found zero bugs so automation isn't paying off" · "coverage is 90%, we're safe". Each swaps a confidence question for a vanity number; re-frame with the Three Questions before acting.

References

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Upgrade an Android project to Android Gradle Plugin (AGP) 9. Use when migrating to AGP 9, updating Gradle build files, migrating to built-in Kotlin, or adopting the new AGP DSL.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

Apply Clean Architecture layering, modularization, and Unidirectional Data Flow in Android projects. Use when setting up project structure, placing code in layers, configuring feature/core modules, or implementing UDF patterns; defer Compose state and ViewModel/StateFlow implementation to their specific skills.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

Implement WorkManager and background processing correctly on Android. Use when creating Worker classes, scheduling tasks, choosing between WorkManager and Foreground Services, or setting up Hilt in workers; defer FCM and notification delivery to android-notifications.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

Build high-performance declarative UI with Jetpack Compose. Use when writing Composable functions, optimizing recomposition, hoisting state, or working with LazyColumn and side effects; defer deep-link and navigation routing to android-navigation.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

Migrate an Android XML View to Jetpack Compose following a structured 10-step workflow. Use when converting XML layouts to Compose, setting up Compose in an existing View-based project, or incrementally adopting Compose.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

Write correct coroutine scopes, lifecycle collection, and dispatcher injection in Android production code. Use for suspend functions, coroutine scopes, and dispatcher mechanics; defer ViewModel StateFlow/LiveData architecture, Fragment lifecycle recipes, persistence/notifications, and unit-test recipes to their specific skills.

日本語の概要は準備中です。原文の説明を表示しています。

HoangNguyen0403/agent-skills-standard5732026年10月12日 更新

HoangNguyen0403 のスキルをすべて見る

このスキルの問題を報告する