Senior Data Engineer

Responsibilities:

• Own the technical design and architecture of scalable data-processing and transformation solutions on GCP.
• Design and build production-grade batch, incremental, and streaming data pipelines.
• Develop and optimize complex transformations using BigQuery, SQL, and Dataform/dbt.
• Build reusable, metadata-driven, and configuration-driven frameworks that reduce bespoke pipeline development.
• Design orchestration patterns using Cloud Composer / Apache Airflow, including dynamic workflows, dependencies, retries, and recovery.
• Develop distributed and streaming processing solutions using Dataflow / Apache Beam and Dataproc / Spark.
• Define standards for data modeling, schema design, schema evolution, and data contracts.
• Design and evolve modern analytical storage patterns, including Apache Iceberg.
• Establish engineering patterns for data quality, reconciliation, metadata, lineage, and observability.
• Optimize large-scale workloads for performance, scalability, latency, and GCP cost.
• Define reusable engineering standards for testing, versioning, CI/CD, and production readiness.
• Lead technical design and code reviews and guide engineers on complex implementation decisions.
• Identify systemic technical debt and drive improvements to shared platform capabilities.
• Work closely with data engineering, platform engineering, DevOps, architecture, governance, and product teams.