Skip to content
cccskills
FreePublished on GitHubEnglish overview

ab-test-setup

Plan experiments by defining a specific hypothesis, variants, primary and guardrail metrics, traffic allocation, and sample size before launch. The skill also provides guidance for running and interpreting results so teams can avoid premature conclusions and document decisions and learnings.

OriginalShow the original description

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.

LeoYeAI/agent-master-skills2,193 stars(GitHub 2,193 + cccskills 0)

Run score Not tested

See how to install

Good for

  • Planning a website A/B test
  • Writing a measurable experiment hypothesis
  • Choosing primary and guardrail metrics
  • Estimating traffic and sample size

Overview

What it does

This skill helps plan A/B tests and experiments with multiple variants. It turns a proposed change into a testable hypothesis and helps define the variants, evaluation metrics, required sample size, and traffic allocation. It organizes a primary metric alongside supporting metrics and guardrails that help detect harmful effects. It also lays out how to wait for the required data, then review confidence intervals and effect size without changing conditions or stopping early. After the test, it can help record the hypothesis, variants, results, decision, and lessons learned.

When it helps

Use it when you want to check whether a page or advertising change improves results through a comparison experiment instead of relying on a guess. It can also help a team agree on what will change and what counts as success before a test begins.

Example requests

  • “Design a hypothesis and metrics for an A/B test of a CTA change.”
  • “Estimate the sample size needed from our current conversion rate and traffic.”
  • “Separate the statistical difference in these results from their practical impact.”

Notes

Implementing test measurement itself is covered by the separate analytics-tracking skill.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Document check

AI checked the SKILL.md for operations that need care and for setup requirements. The score comes only from actually running the skill (hands-on test).

SafetyAre sending data, deleting files, and running commands disclosed?
AGoodIt says not to stop early or change variants; no risky external action is specified.
Easy setupDoes it need few tools or API keys, and are they documented?
AGoodIt checks optional context files but specifies no required installation or API key.

Not counted in the score. Rated by AI (OpenAI Codex) as of Nov 15, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (3)

  • SKILL.md7.0 KB
  • references/sample-size-guide.md7.3 KB
  • references/test-templates.md6.3 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

0codekit

FreeSummary

Connect an agent to 0codekit workspace data through the Membrane CLI. The supplied guide lists many data types across spreadsheets, databases, documents, tasks, calendars, email, and other services, while noting that the exact request may need clarification.

  • Working with spreadsheet rows and columns
  • Accessing workspace tasks or calendar events
  • Handling records across listed data sources
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

0xarchive

FreeSummary

Query historical and current crypto market data for Hyperliquid, Lighter.xyz, and HIP-3, including prices, candles, order books, trades, funding rates, open interest, and liquidations. Check data freshness and coverage to understand what records are available.

  • Looking up historical prices or candles for a supported exchange
  • Reviewing order book or trade history
  • Checking funding rates and open interest over time
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

12-factor-apps

FreeSummary

Review a codebase against the 12-Factor App principles for SaaS architecture. Get a factor-by-factor Strong, Partial, or Weak assessment, evidence and gaps, plus prioritized recommendations for improving portability, deployment, and scaling.

  • Auditing a SaaS application's architecture
  • Reviewing a cloud-native application
  • Planning a cloud migration
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Plan personal or team projects in repeating 13-day cycles inspired by the Maya calendar. Each of 13 daily tones suggests a focus, from setting a goal and taking action to sharing results, cleaning up, and reflecting.

  • Planning a focused 13-day personal project
  • Giving a team sprint a daily focus
  • Checking the suggested focus for today
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Estimate intracellular reaction rates from steady-state carbon-13 tracing measurements. Validate carbon atom mappings and measurement inputs, simulate labeling, fit constrained fluxes, and diagnose which pathway rates the data can meaningfully constrain.

  • Estimate metabolic fluxes from carbon-13 labeling
  • Validate atom mappings and measurement inputs
  • Simulate labeling for proposed reaction rates
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

Learn how to source products through 1688.com with guided steps for choosing products, checking suppliers, requesting samples, negotiating prices, and comparing shipping options. The skill also highlights common listing and payment risks and explains when an order may call for help from a sourcing expert.

  • Checking a 1688 supplier before placing an order
  • Planning product selection for a target market and budget
  • Drafting a supplier message to negotiate price or samples
LeoYeAI/agent-master-skills2.2KUpdated Nov 1, 2026

See all skills by LeoYeAI

Report a problem with this skill