skills sourced live from GitHub · all skills listed are free · each skill is provided under its author's license.
home / Finance / Backtesting Frameworks Skill by @wshobson
The skill is the plugins/quantitative-trading/skills/backtesting-frameworks folder inside that repository. Copy it into the folder your agent loads skills from; check your agent's documentation for where that is.
Principles for trustworthy trading strategy backtests, covering look-ahead and survivorship bias, costs and walk-forward analysis.
Explains common biases, a proper backtest structure and walk-forward validation, with best practices. Its focus is avoiding results that look good only because of flawed testing.
The original SKILL.md is organised into these sections:
Written and maintained by @wshobson. It is published under the MIT license, which allows reuse with attribution. See the author profile. SkillDirectory does not claim authorship: this page adds our own review and links back to the original, and the skill's text belongs to its author.
# Backtesting Frameworks Build robust, production-grade backtesting systems that avoid common pitfalls and produce reliable strategy performance estimates. ## When to Use This Skill - Developing trading strategy backtests - Building backtesting infrastructure - Validating strategy performance - Avoiding common backtesting biases - Implementing walk-forward analysis - Comparing strategy alternatives ## Core Concepts ### 1. Backtesting Biases | Bias | Description | Mitigation | | ---------------- | ------------------------- | ----------------------- | | **Look-ahead** | Using future information | Point-in-time data | | **Survivorship** | Only testing on survivors | Use delisted securities | | **Overfitting** | Curve-fitting to history | Out-of-sample testing | | **Selection** | Cherry-picking strategies | Pre-registration | | **Transaction** | Ignoring trading costs | Realistic cost models | …
Excerpt only, quoted from the author's repository. Open the repository for the complete file.