跳到正文
cccskills
免费在 GitHub 公开

ab-test-setup-and-analysis

Plan and analyze A/B tests for Google and Meta advertising. Estimate required traffic and duration, track results, and assess whether observed differences are statistically significant, meaning unlikely to be explained by chance alone.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

Designs statistically valid split tests for ads, audiences, landing pages, or bid strategies. Calculates required sample sizes before you start, monitors results during the test, and calls winners when statistical significance is actually reached — not when you feel like one is winning. Platform: Google and Meta.

实测评分 未实测

查看安装方法

适用场景

  • Planning a test for a new ad headline
  • Estimating traffic and time needed for a landing page test
  • Checking whether interim results justify choosing a winner
  • Deciding what to roll out or test next

包含的文件(1)

  • SKILL.md2.9 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

28/ A/B Test Setup and Analysis — Google + Meta

What it does

Designs statistically valid split tests for ads, audiences, landing pages, or bid strategies. Calculates required sample sizes before you start, monitors results during the test, and calls winners when statistical significance is actually reached — not when you feel like one is winning.

How it works

Claude takes your test hypothesis, current baseline metrics, and the minimum detectable effect you care about, then calculates how much traffic and time the test needs to produce a reliable result. During the test, it tracks results and tells you whether differences are statistically significant or just noise. It prevents premature test calls that waste the effort.

Practical example

You want to test a new headline variant against your current best performer. Your current ad gets a 2.8% CTR with 1,200 daily impressions. Claude calculates that to detect a 15% improvement (3.22% CTR) with 95% confidence, you need approximately 12,400 impressions per variant — about 10 days at current traffic levels. After 7 days, the new variant shows 3.1% CTR vs 2.7% for control. Claude tells you it's trending positive but not yet significant (p=0.14, need p<0.05) — keep running for 4 more days before making a call.

What you get back

  • Test design with clear hypothesis, control, variant, and success metric
  • Required sample size and estimated test duration before you start
  • Daily monitoring with current results, confidence level, and days remaining
  • Winner call only when significance is reached, with effect size and confidence interval
  • Post-test recommendations: roll out winner, iterate further, or test something else

When to use it

  • Before launching any creative, audience, or landing page test
  • When someone on the team wants to call a winner after 2 days of data
  • For structured testing programs where you need a pipeline of tests running sequentially
  • When clients ask "is this result real or just noise" and you need a definitive answer

Data access (Ryze MCP)

This skill works best with live account data. Connect the free Ryze MCP once and Claude reads your Google Ads, Meta Ads, GA4 and Search Console directly:

  • claude.ai / Claude Desktop: Settings → Connectors → Add custom connector → https://connector.get-ryze.ai/mcp
  • Claude Code: claude mcp add ryze --transport http https://connector.get-ryze.ai/mcp
  • Cursor: Settings → MCP → add the same URL

Setup guide: https://www.get-ryze.ai/how-to-connect-claude-to-google-meta-ads-mcp

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Analyze A/B test results to assess whether observed differences are likely due to chance. Check test duration and sample size, compare audience segments, distinguish statistical findings from practical value, and generate hypotheses for follow-up tests.

中文简介正在准备中。当前显示英语简介。

  • Evaluating results from a headline A/B test
  • Estimating sample sizes before starting a test
  • Comparing results by device or traffic source
irinabuht12-oss/marketing-skills54922026年10月13日 更新

Review Google and Meta campaign structures against goals, budgets, and conversion data. Identify excessive segmentation, overlapping targeting, and fragmented budgets, then get consolidation recommendations, an explained account structure, and a migration plan.

中文简介正在准备中。当前显示英语简介。

  • Reviewing an account inherited from another team or agency
  • Running a quarterly advertising account health check
  • Investigating structural causes of stalled performance
irinabuht12-oss/marketing-skills54922026年10月13日 更新

Analyze successful Google and Meta ads to find useful patterns in headlines, body text, and calls to action. Generate new copy variants that preserve those patterns, with platform formatting, test priorities, and suggested pairings for comparison.

中文简介正在准备中。当前显示英语简介。

  • Refreshing ad copy when existing creatives lose effectiveness
  • Starting an ad copy brainstorming session
  • Testing messaging angles for a new audience
irinabuht12-oss/marketing-skills54922026年10月13日 更新

Review Google Ads extensions, the extra links and details shown with ads, across campaigns. Find missing coverage, weak performance, and outdated information, then get replacement copy based on successful ads and landing pages, plus rollout priorities.

中文简介正在准备中。当前显示英语简介。

  • Checking extension coverage before launching campaigns
  • Quarterly reviews of outdated promotional details
  • Updating extensions after website changes or product launches
irinabuht12-oss/marketing-skills54922026年10月13日 更新

Analyze spending, revenue, and conversions across advertising channels to recommend budget shifts. Compare overall efficiency with the revenue gained from additional spending, identify saturation, and produce a gradual reallocation plan with monitoring priorities.

中文简介正在准备中。当前显示英语简介。

  • Reviewing budget allocation across advertising channels
  • Finding channels with declining returns on extra spending
  • Balancing proven campaigns with new experiments
irinabuht12-oss/marketing-skills54922026年10月13日 更新

Build a question set to check whether AI assistants mention your brand. Analyze the answers you collect, compare visibility against competitors, trace cited sources, and receive a prioritized list of opportunities to address gaps.

中文简介正在准备中。当前显示英语简介。

  • Establishing a baseline for brand visibility in AI answers
  • Comparing brand mentions and citations with competitors
  • Tracking visibility changes each quarter
irinabuht12-oss/marketing-skills54922026年10月13日 更新

查看 irinabuht12-oss 的全部技能

报告此技能的问题