Skip to content
cccskills
FreePublished on GitHubEnglish overview

ab-testing

Plan and evaluate A/B tests with a clear hypothesis, primary and guardrail metrics, sample size, and stopping rule. The skill also helps prioritize experiment ideas, interpret results carefully, and maintain a repeatable growth experimentation program.

OriginalShow the original description

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro.

LeoYeAI/agent-master-skills2,193 stars(GitHub 2,193 + cccskills 0)

Run score Not tested

See how to install

Good for

  • Planning an A/B test for a product change
  • Choosing metrics and estimating required sample size
  • Interpreting a completed experiment without overclaiming
  • Prioritizing and documenting a growth experiment backlog

Overview

What it does

This skill helps you design experiments to measure the effect of a proposed change. It organizes the hypothesis, target audience, primary and supporting metrics, and guardrail metrics that track unwanted effects. It covers A/B and A/B/n tests, tests that combine multiple elements, and split-URL tests. It also helps consider sample size, traffic allocation, and pre-launch checks. The guidance emphasizes choosing the analysis method and stopping rule before a test begins, then following them instead of stopping early after checking interim results or changing conditions mid-test.

When interpreting results, the skill considers effect size, confidence intervals, and guardrails alongside statistical significance. It helps keep conclusions within what the data support. For ongoing work, it describes prioritizing ideas with ICE (impact, confidence, ease) and recording results and lessons in an experiment playbook.

When it helps

Use it to compare options such as button wording or page layouts, estimate the traffic and time a test may need, or make a careful decision when results are uncertain. It can also help turn isolated tests into a continuing experimentation practice.

Example requests

  • “Design an A/B test to compare changes to our pricing page.”
  • “Estimate the sample size from our traffic and expected improvement.”
  • “Interpret these results, including the metrics and uncertainty.”

Notes

The related analytics skill covers tracking implementation. The cro skill covers page-level conversion improvement ideas.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Document check

AI checked the SKILL.md for operations that need care and for setup requirements. The score comes only from actually running the skill (hands-on test).

SafetyAre sending data, deleting files, and running commands disclosed?
AGoodIt addresses result interpretation and contains no instructions to send data externally or modify files.
Easy setupDoes it need few tools or API keys, and are they documented?
BPartly lackingIt asks about traffic, tracking, and implementation, but provides limited setup instructions and tool requirements.

Not counted in the score. Rated by AI (OpenAI Codex) as of Nov 15, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (4)

  • SKILL.md13.0 KB
  • evals/evals.json8.8 KB
  • references/sample-size-guide.md9.0 KB
  • references/test-templates.md6.3 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

0codekit

FreeSummary

Connect an agent to 0codekit workspace data through the Membrane CLI. The supplied guide lists many data types across spreadsheets, databases, documents, tasks, calendars, email, and other services, while noting that the exact request may need clarification.

  • Working with spreadsheet rows and columns
  • Accessing workspace tasks or calendar events
  • Handling records across listed data sources
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

0xarchive

FreeSummary

Query historical and current crypto market data for Hyperliquid, Lighter.xyz, and HIP-3, including prices, candles, order books, trades, funding rates, open interest, and liquidations. Check data freshness and coverage to understand what records are available.

  • Looking up historical prices or candles for a supported exchange
  • Reviewing order book or trade history
  • Checking funding rates and open interest over time
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

12-factor-apps

FreeSummary

Review a codebase against the 12-Factor App principles for SaaS architecture. Get a factor-by-factor Strong, Partial, or Weak assessment, evidence and gaps, plus prioritized recommendations for improving portability, deployment, and scaling.

  • Auditing a SaaS application's architecture
  • Reviewing a cloud-native application
  • Planning a cloud migration
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Plan personal or team projects in repeating 13-day cycles inspired by the Maya calendar. Each of 13 daily tones suggests a focus, from setting a goal and taking action to sharing results, cleaning up, and reflecting.

  • Planning a focused 13-day personal project
  • Giving a team sprint a daily focus
  • Checking the suggested focus for today
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Estimate intracellular reaction rates from steady-state carbon-13 tracing measurements. Validate carbon atom mappings and measurement inputs, simulate labeling, fit constrained fluxes, and diagnose which pathway rates the data can meaningfully constrain.

  • Estimate metabolic fluxes from carbon-13 labeling
  • Validate atom mappings and measurement inputs
  • Simulate labeling for proposed reaction rates
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Learn how to source products through 1688.com with guided steps for choosing products, checking suppliers, requesting samples, negotiating prices, and comparing shipping options. The skill also highlights common listing and payment risks and explains when an order may call for help from a sourcing expert.

  • Checking a 1688 supplier before placing an order
  • Planning product selection for a target market and budget
  • Drafting a supplier message to negotiate price or samples
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

See all skills by LeoYeAI

Report a problem with this skill