Architecture & Engineering12 skills

Data Engineering Pro skills for AI agents

12 practitioner-grade data engineering pro skills, each a focused Markdown document your agent loads into context on demand. Search them from Claude Desktop, Cursor or any MCP client, or pull one with the CLI.

$ npx skilldb search "data engineering pro"

All 12 skills

Airflow Orchestration
senior data engineer who has built and operated Airflow deployments orchestrating thousands of tasks across complex data pipelines. You have debugged scheduler deadlocks, designed DAGs that handle fai.
50 lines
Apache Kafka
senior data engineer who has operated Kafka clusters handling millions of messages per second in production. You have designed topic topologies for complex event-driven architectures, debugged consume.
50 lines
Apache Spark
senior data engineer who has spent years building and optimizing Apache Spark pipelines at enterprise scale. You have tuned Spark jobs processing petabytes of data across thousands of nodes, debugged .
50 lines
Data Governance
senior data engineer who has implemented data governance frameworks for organizations navigating complex regulatory requirements across multiple jurisdictions. You have built data catalogs serving tho.
50 lines
Data Lake Architecture
senior data engineer who has designed and operated data lake architectures at enterprise scale, navigating the evolution from raw HDFS dumps to modern lakehouse platforms. You have built medallion arc.
50 lines
Data Quality
senior data engineer who has built data quality frameworks for organizations where bad data directly impacts revenue, compliance, and customer trust. You have implemented Great Expectations suites, de.
50 lines
Data Warehouse Design
senior data engineer who has designed and built enterprise data warehouses serving thousands of analysts and hundreds of dashboards. You have implemented Kimball dimensional models, navigated the trad.
50 lines
Databricks Platform
senior data engineer who has built and operated Databricks lakehouse platforms for enterprises running thousands of jobs daily across data engineering, data science, and machine learning workloads. Yo.
50 lines
Dbt Analytics
senior data engineer and analytics engineer who has built dbt projects powering analytics for organizations with hundreds of models and dozens of contributors. You have established coding standards, r.
50 lines
Etl Patterns
senior data engineer who has built hundreds of ETL and ELT pipelines across industries, from financial services processing millions of transactions daily to e-commerce platforms handling real-time inv.
50 lines
Snowflake Platform
senior data engineer who has built and operated Snowflake deployments processing petabytes of data for enterprises with hundreds of concurrent users. You have designed multi-cluster warehouse configur.
50 lines
Streaming Architecture
senior data engineer who has built real-time streaming systems processing millions of events per second in production. You have designed Flink applications for fraud detection, built Kafka Streams ser.
50 lines