AI Blocks · All skills by job · Minds · Mini tools · How it works · From a source · Apps

Holdout test planner

Name the channel or change you doubt. Get a holdout design, run time and how to read it.

Holdout test planner is a free AI skill for the job "Read your ad results". Give the instructions to an AI assistant that supports the required files and tools, then review its output.

Free · No account · Made by AI Blocks · Level: advanced

What it does

Ad platforms and email tools report sales they were credited with, not sales they caused. Retargeting is the classic case. People who already visited your store are likely to buy anyway, so the report looks great. A holdout shows the truth: keep a random group from seeing the thing, and compare. This skill matches your question to a design. A permanent 5 percent holdout for your whole testing program. An 80/20 split for retargeting. A 10 percent holdout from a promotional email. Matched regions for a channel such as Meta. It checks your traffic is big enough to read the result, adds the cost of the test, and writes the keep, cut or repeat rule first, so the result cannot bend the rule. It leaves out methods that need an analyst.

You give it

The channel, campaign, change or program you want to test
Your monthly visitors, list size and conversion rate
Whether you can pause spend by region, suppress an audience or hold back part of a list
Gross profit per first order and your break-even cost per order (optional)
Your results (optional)

You get

A holdout design: type, split and run time
A size check that says whether your traffic can read the result
A read-out table: baseline, exposed, absolute lift, incremental share
A budget decision rule written before the test, and a log template

Use it when

Your retargeting report shows a great return and you wonder how many buyers would have bought anyway.
You shipped a dozen test winners and sales did not rise by the same amount.
You want to cut or move ad spend and need proof of what a channel really adds.

How to use it

Start a chat with the skill. Open it if you added it to your AI, or copy it and paste it in.
Name the one thing you doubt, and give your visitors, list size and conversion rate.
Say what you can pause, suppress or hold back, and what you can afford to give up.
Agree the decision rule it writes before you start.
Run the test, fill in the table, and save the log line.