← All plays
LP
Launch partner
Creator

A/B Test Readout

Know which version won, and whether it is real

Raised by customers on 25+ calls in the past year

Reads an A/B test, tells you which version won on meetings and positive replies, and whether the gap is real or just noise.

Learn
Luna
Reviewed by Alta

What it does

  1. Reads both versions and their results
  2. Compares them on positive replies and meetings
  3. Tests whether the gap is real given the sample size
  4. Calls a winner, or says how long to keep running

You give it

  • The test to read

You get

  • The winner, or an honest not yet
  • How confident the result is

Why it works

Calling a test on noise teaches the team the wrong lesson. A clear readout keeps only the wins that will hold.

Run this play

Copy the SKILL.md below into your agent
Works in Alta, Claude, Cursor and Codex
Runs on
Luna
Category
Learn
CostAlta credits per run, shown before it runs
ApprovalEvery run stops at a draft for you
--- name: ab-test-readout description: Read an A/B test on messages or subject lines, pick the winner on positive replies and meetings, and say whether the difference is real or noise. Use when someone asks about A/B tests, split tests or which variant won. agent: Luna category: Learn ends_in: readout --- # A/B Test Readout Most A/B tests are called too early. This play tells you when it is real. ## How it runs 1. **Read both versions** and their results 2. **Compare on positive replies and meetings**, not opens 3. **Test if the gap is real** given the sample size 4. **Call it** - winner, no difference yet, or keep running and how long ## Rules - Never call a winner without enough results - Say how many more sends are needed when it is too early ## What you get - The winner, or an honest not yet - How confident the result is
- The winner is called on meetings or positive replies, not opens - Too-early tests get an honest not yet, with the sends still needed - The confidence of the result is stated in plain words
The play fileSKILL.md

This is the whole play. Read it, copy it, or change it for your team - it runs the same in Alta, Claude, Cursor and Codex.

Install this play
Claude app or claude.aiUpload the zip as a skill

Download the zip, then upload it as a skill in your Claude settings. Code execution needs to be on.

Claude CodeDrop the folder in

Unzip it into your skills folder. Claude Code finds it on its own.

~/.claude/skills/
Cursor and other agentsAdd the SKILL.md

Put the folder where your agent reads skills, for example:

.cursor/skills/

Run it where you work

Same play, same result. Pick the place you already are.

In Alta

One click

Open Skills in Alta, pick the play and press Run. Or ask Ask Alta to run it for the companies you care about.

In Claude

Ask in plain words

Connect Alta to Claude and describe the target. Claude loads the play, the agent does the work, and the draft opens in Alta for you to approve.

In Cursor or Codex

Drop in the file

Add the SKILL.md to your agent's skills folder with the Alta plugin connected. Edit it like code, and keep your team's version in the repo.