AI Blocks › Test changes to your store
Store test verdict maker
Give it test numbers and dates. Get valid or not, the lift as a range, a ship call and a trust score.
Store test verdict maker is a free AI skill for the job "Test changes to your store". Give the instructions to an AI assistant that supports the required files and tools, then review its output.
Free · No account · Made by AI Blocks · Level: advanced · Thinking: high
What it does
A test that finished with a green "winner" banner is not yet a result. Many winners come from stopping early, an uneven traffic split, an email send that spiked sales, or a tracking bug. If you check a test every day and stop at the first good look, a 5 percent chance of a false alarm can grow to about 26 percent. This skill checks the test before it reads the result. It tests the split, the run length, early stopping, tracking and anything else that changed. Then it gives the lift as a range, turns both ends into gross profit per month, and checks that order value, margin and returns did not get worse. It ends with one call and a log entry, so the lesson is saved. It is the store version of the general A/B test verdict maker.
You give it
- Visitors and conversions for each version, the planned split, and the planned sample and dates
- The main metric and your guardrails, such as order value, margin and returns
- Any sale, email send, outage, price change or tracking change during the run
- Gross profit per order and the smallest gain worth shipping (optional)
- Monthly visitors to the page (optional)
- Plan (optional)
You get
- Pass or fail on the split, run length, early stopping and tracking checks
- The lift as a range, and what it is worth per month in gross profit
- One call: ship, do not ship, re-test or inconclusive
- A trust score out of 100 with the sum shown, and a test log entry
Use it when
- Your testing tool shows a winner and you are about to roll it out.
- A test ended with no clear result and you want to know what that means.
- A lift looks too good to be true and you want to check it before you plan around it.
How to use it
- Start a chat with the skill. Open it if you added it to your AI, or copy it and paste it in.
- Paste the numbers for each version from your testing tool, with the start and end dates.
- List anything that changed during the test, such as sales, email sends or site changes.
- Add your gross profit per order and the smallest gain worth shipping, if you know them.
- Save the log entry it gives you, then act on the call.
Workflows that use it
- Find where your page loses buyers and prove the fix
- Raise order value with bundles and add-ons you can check
- Read a finished store test and pick the next one
- Rewrite your store's top screen and know if it won
- Run one store test and know whether to ship
- Store test program runner