$ skilldirectory
— zsh — registry.skilldirectory.dev
skill library blog

home / Testing & QA / Ab Test Setup Skill by @sickn33

Ab Test Setup Skill by @sickn33

FREE
github stars★ 46,768updatedSep 2026repo@sickn33
$git clone https://github.com/sickn33/agentic-awesome-skills

The skill is the plugins/agentic-awesome-skills-claude/skills/ab-test-setup folder inside that repository. Copy it into the folder your agent loads skills from; check your agent's documentation for where that is.

Read the opening of the original SKILL.md
# A/B Test Setup

## 1️⃣ Purpose & Scope

Define an experiment that can answer a specific product question, and verify its assumptions before exposing users. This procedure cannot guarantee validity by itself.

- Documents the stopping rule
- Estimates sample needs under stated assumptions
- Makes the hypothesis and decision criteria reviewable

---

## 2️⃣ Pre-Requisites

You must have:

- A clear user problem
- Access to an analytics source
- Roughly estimated traffic volume

### Hypothesis Quality Checklist

A valid hypothesis includes:

- Observation or evidence
- Single, specific change
- Directional expectation
- Defined audience
- Measurable success criteria

---

## 3️⃣ Hypothesis Lock (Hard Gate)

Before designing variants or metrics, you MUST:

- Present the **final hypothesis**
- Specify:
  - Target audience
  - Primary metric
  - Expected direction of effect
  - Minimum Detectable Effect (MDE)
…

Excerpt only, quoted from the author's repository. Open the repository for the complete file.