Paid Media Experiment
SkillMediaYour AI can design and evaluate paid-ad A/B tests from start to finish. It turns a test idea into a concrete plan with hypotheses, sample sizes, and durations, then analyzes the results and applies decision rules so you know what to do next.
Available today. Use it from your connected AI after setup.
No other account needed.
After adding it, describe the ad test you have in mind and your AI will draft the experiment design, including sample size, duration, and decision rules.
Then ask your AI: use the Paid Media Experiment skill
What your AI can do with it
- Design paid-ad experiments with clear hypotheses
- Estimate required sample sizes and test durations
- Set guardrails to keep experiments on track
- Analyze results for statistical significance
- Apply decision rules to the results
- Work with randomization units and platform experiment tools
What this skill tells your AI
The instructions your AI receives, as published by agricidaniel/claude-ads in skills/ads-test/SKILL.md and read by ahel’s review.
- State the decision, causal hypothesis, treatment, control, randomization unit, population, primary metric, guardrails, minimum effect, and stopping rule.
- Check platform constraints, overlapping experiments, conversion lag, seasonality, interference, and measurement quality.
- Calculate sample and duration from declared assumptions; disclose approximations.
- Change one decision surface unless the design explicitly estimates interactions.
- Pre-register exclusions, quality checks, analysis, and decision thresholds.
- For readout, verify assignment integrity and data completeness before estimating effect and uncertainty.
- Return setup or readout in versioned JSON with a plain-language decision.
Do not repeatedly peek and stop on a favorable result, call underpowered noise a winner, or generalize beyond the tested population.
Signals
- GitHub stars
- 9k
- Forks
- 1k
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
ads-test- Source
- github.com/agricidaniel/claude-ads