Database

Configure Airbyte open-source data integration with custom connectors, destinations, and CDC replication.

Orchestrate data pipelines using Apache Airflow DAGs, operators, sensors, and XCom.

Process large-scale data with Apache Spark using PySpark DataFrames, Spark SQL, and structured streaming.

Build analytical pipelines on Google BigQuery using SQL, streaming inserts, and federated queries.

Build high-performance OLAP queries on ClickHouse using MergeTree engines, materialized views, and aggregations.

Build and test data transformation pipelines using dbt models, macros, and incremental strategies.

Configure and manage Fivetran connectors for automated data ingestion into warehouses.

Build and optimize data pipelines on Snowflake using SQL, stages, streams, tasks, and Snowpipe.