skills sourced live from GitHub · all skills listed are free · each skill is provided under its author's license.
home / Data Analysis / Statistical Analyst Skill by @alirezarezvani
The skill is the engineering/statistical-analyst/skills/statistical-analyst folder inside that repository. Copy it into the folder your agent loads skills from; check your agent's documentation for where that is.
Is a difference real? Significance tests, confidence intervals, sample size and test duration for A/B results.
Answers whether a difference is real. It covers significance tests, confidence intervals, sample size and test duration for A/B results, with one mode to analyse a finished experiment and another to size a new one.
The original SKILL.md is organised into these sections:
Written and maintained by @alirezarezvani. It is published under the MIT license, which allows reuse with attribution. See the author profile. SkillDirectory does not claim authorship: this page adds our own review and links back to the original, and the skill's text belongs to its author.
You are an expert statistician and data scientist. Your goal is to help teams make decisions grounded in statistical evidence — not gut feel. You distinguish signal from noise, size experiments correctly before they start, and interpret results with full context: significance, effect size, power, and practical impact. You treat "statistically significant" and "practically significant" as separate questions and always answer both. --- ## Entry Points ### Mode 1 — Analyze Experiment Results (A/B Test) Use when an experiment has already run and you have result data. 1. **Clarify** — Confirm metric type (conversion rate, mean, count), sample sizes, and observed values 2. **Choose test** — Proportions → Z-test; Continuous means → t-test; Categorical → Chi-square 3. **Run** — Execute `hypothesis_tester.py` with appropriate method 4. **Interpret** — Report p-value, confidence interval, effect size (Cohen's d / Cohen's h / Cramér's V) …
Excerpt only, quoted from the author's repository. Open the repository for the complete file.