skills sourced live from GitHub · all skills listed are free · each skill is provided under its author's license.
home / Data Analysis / Data Quality Frameworks Skill by @wshobson
The skill is the plugins/data-engineering/skills/data-quality-frameworks folder inside that repository. Copy it into the folder your agent loads skills from; check your agent's documentation for where that is.
Implement data quality validation with Great Expectations, dbt tests, and data contracts.
Shows how to validate data with Great Expectations, dbt tests and data contracts, from quality dimensions to a testing pyramid for data pipelines.
The original SKILL.md is organised into these sections:
Written and maintained by @wshobson. It is published under the MIT license, which allows reuse with attribution. See the author profile. SkillDirectory does not claim authorship: this page adds our own review and links back to the original, and the skill's text belongs to its author.
# Data Quality Frameworks Production patterns for implementing data quality with Great Expectations, dbt tests, and data contracts to ensure reliable data pipelines. ## When to Use This Skill - Implementing data quality checks in pipelines - Setting up Great Expectations validation - Building comprehensive dbt test suites - Establishing data contracts between teams - Monitoring data quality metrics - Automating data validation in CI/CD ## Core Concepts ### 1. Data Quality Dimensions | Dimension | Description | Example Check | | ---------------- | ------------------------ | -------------------------------------------------- | | **Completeness** | No missing values | `expect_column_values_to_not_be_null` | | **Uniqueness** | No duplicates | `expect_column_values_to_be_unique` | | **Validity** | Values in expected range | `expect_column_values_to_be_in_set` | …
Excerpt only, quoted from the author's repository. Open the repository for the complete file.