Skip to content
cccskills
FreePublished on GitHub

test-reporting-analytics

Advanced test reporting, quality dashboards, predictive analytics, trend analysis, and executive reporting for QE metrics. Use when communicating quality status, tracking trends, or making data-driven decisions.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515 stars(GitHub 515 + cccskills 0)

Run score Not tested

See how to install

Files included (4)

  • SKILL.md5.6 KB
  • evals/test-reporting-analytics.yaml3.2 KB
  • schemas/output.json10.0 KB
  • scripts/validate-config.json569 B

SKILL.md (original)

Review the instructions the agent will receive before you install.

Test Reporting & Analytics

<default_to_action> When building test reports:

  1. DEFINE audience (dev team vs executives)
  2. CHOOSE key metrics (max 5-7)
  3. SHOW trends (not just snapshots)
  4. HIGHLIGHT actions (what to do about it)
  5. AUTOMATE generation

Dashboard Quick Setup:

+------------------+------------------+------------------+
| Tests Passed     | Code Coverage    | Flaky Tests      |
| 1,247/1,250 ✅   | 82.3% ⬆️ +2.1%  | 1.2% ⬇️ -0.3%   |
+------------------+------------------+------------------+
| Critical Bugs    | Deploy Freq      | MTTR             |
| 0 open ✅        | 12x/day ⬆️       | 2.3h ⬇️          |
+------------------+------------------+------------------+

Key Metrics by Audience:

  • Dev Team: Pass rate, flaky %, execution time, coverage gaps
  • QE Team: Defect detection rate, test velocity, automation ROI
  • Leadership: Escaped defects, deployment frequency, quality cost </default_to_action>

Quick Reference Card

Essential Metrics

CategoryMetricTarget
ExecutionPass Rate>98%
ExecutionFlaky Test %<2%
ExecutionSuite Duration<10 min
CoverageLine Coverage>80%
CoverageBranch Coverage>70%
QualityEscaped Defects<5/release
QualityMTTR<4 hours
EfficiencyAutomation Rate>90%

Trend Indicators

SymbolMeaningAction
⬆️ImprovingContinue current approach
⬇️DecliningInvestigate root cause
➡️StableMaintain or improve
⚠️Threshold breachImmediate attention

Report Types

Real-Time Dashboard

Live quality status for CI/CD
- Build status (green/red)
- Test results (pass/fail counts)
- Coverage delta
- Flaky test alerts

Sprint Summary

## Sprint 47 Quality Summary

### Metrics
| Metric | Value | Trend |
|--------|-------|-------|
| Tests Added | +47 | ⬆️ |
| Coverage | 82.3% | ⬆️ +2.1% |
| Bugs Found | 12 | ➡️ |
| Escaped | 0 | ✅ |

### Highlights
- ✅ Zero escaped defects
- ⚠️ E2E suite now 45min (target: 30min)

### Actions
1. Optimize slow E2E tests
2. Add coverage for payment module

Executive Report

## Monthly Quality Report - Oct 2025

### Executive Summary
✅ Production uptime: 99.97% (target: 99.95%)
✅ Deploy frequency: 12x/day (up from 8x)
⚠️ Coverage: 82.3% (target: 85%)

### Business Impact
- Automation saves 120 hrs/month
- Bug cost: $150/bug found vs $5,000 escaped
- Estimated annual savings: $450K

### Recommendations
1. Invest in performance testing tooling
2. Hire senior QE for mobile coverage

Predictive Analytics

// Predict test failures
const prediction = await Task("Predict Failures", {
  codeChanges: prDiff,
  historicalData: last90Days,
  model: 'gradient-boosting'
}, "qe-quality-analyzer");

// Returns:
// {
//   failureProbability: 0.73,
//   likelyFailingTests: ['payment.test.ts'],
//   suggestedAction: 'Review payment module carefully',
//   confidence: 0.89
// }

// Trend analysis with anomaly detection
const trends = await Task("Analyze Trends", {
  metrics: ['passRate', 'coverage', 'flakyRate'],
  period: '30d',
  detectAnomalies: true
}, "qe-quality-analyzer");

Agent Integration

// Generate comprehensive quality report
const report = await Task("Generate Quality Report", {
  period: 'sprint',
  audience: 'executive',
  includeROI: true,
  includeTrends: true
}, "qe-quality-analyzer");

// Real-time quality gate check
const gateResult = await Task("Quality Gate Check", {
  metrics: currentMetrics,
  thresholds: qualityPolicy,
  environment: 'production'
}, "qe-quality-gate");

Agent Coordination Hints

Memory Namespace

aqe/reporting/
├── dashboards/*      - Dashboard configurations
├── reports/*         - Generated reports
├── trends/*          - Trend analysis data
└── predictions/*     - Predictive model outputs

Fleet Coordination

const reportingFleet = await FleetManager.coordinate({
  strategy: 'quality-reporting',
  agents: [
    'qe-quality-analyzer',      // Metrics aggregation
    'qe-quality-gate',          // Threshold validation
    'qe-deployment-readiness'   // Release readiness
  ],
  topology: 'parallel'
});

Related Skills


Remember

Measure to improve. Report to communicate.

Good reports:

  • Answer "so what?" (actionable insights)
  • Show trends (not just snapshots)
  • Match audience needs
  • Automate where possible

Data without action is noise. Action without data is guessing.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Use when running comprehensive WCAG accessibility audits with axe-core + pa11y + Lighthouse, generating context-aware remediation, or testing video accessibility. Supports 3-tier browser cascade with graceful degradation.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

WCAG 2.2 compliance testing, screen reader validation, and inclusive design verification. Use when ensuring legal compliance (ADA, Section 508), testing for disabilities, or building accessible applications for 1 billion disabled users globally.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

Master advanced AgentDB features including QUIC synchronization, multi-database management, custom distance metrics, hybrid search, and distributed systems integration. Use when building distributed AI systems, multi-agent coordination, or advanced vector search applications.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

Create and train AI learning plugins with AgentDB's 9 reinforcement learning algorithms. Includes Decision Transformer, Q-Learning, SARSA, Actor-Critic, and more. Use when building self-learning agents, implementing RL, or optimizing agent behavior through experience.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

Implement persistent memory patterns for AI agents using AgentDB. Includes session memory, long-term storage, pattern learning, and context management. Use when building stateful agents, chat systems, or intelligent assistants.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

Optimize AgentDB performance with quantization (4-32x memory reduction), HNSW indexing (150x faster search), caching, and batch operations. Use when optimizing memory usage, improving search speed, or scaling to millions of vectors.

The English summary is being prepared. Showing the original description.

proffesor-for-testing/agentic-qe515Updated Oct 26, 2026

See all skills by proffesor-for-testing

Report a problem with this skill