Senior Data Engineer

Senior Data Engineer

Experience: 5+ yrs of overall experience

Primary Skills (Must-Have): Apache Iceberg, Apache Kafka, Apache Flink, Snowflake, Python, SQL, AWS

Location: Remote (Base Location: Hyderabad)

Shift: IST/PST Overlap shift

Key Responsibilities

• Design logical and physical data models.
• Develop analytics-ready Tier-2 data models using dimensional modelling and star-schema principles where appropriate.
• Define facts, dimensions, relationships, measures, and transformations.
• Develop ingestion, transformation, and orchestration pipelines.
• Implement batch and streaming data-processing workflows.
• Support data replication and historical backfills.
• Develop data-quality controls and validation logic.
• Perform unit, integration, regression, and data-quality testing.
• Reconcile source and target datasets.
• Prepare production-ready code, configuration, and models.
• Participate in code reviews and approved release processes.
• Support production deployment and post-deployment validation.
• Troubleshoot defects and perform root-cause analysis.
• Create technical documentation, release notes, and operational materials.
• Participate in daily stand-ups, design reviews, demonstrations, and knowledge-transfer activities.

Required Qualifications

• 5+years of professional data engineering or distributed-systems experience.
• Strong production experience with batch and streaming data architectures.
• Experience building and maintaining production data pipelines.
• Experience with dimensional data modelling and star-schema design.
• Strong programming skills using Python, Java, and SQL.
• Experience with data quality, automated testing, and production troubleshooting.
• Experience with source control, CI/CD, code reviews, and agile engineering practices.
• Ability to work effectively within a distributed global engineering team.

Required Technologies

• Apache Iceberg
• Apache Airflow
• Apache Spark
• Apache Kafka
• Apache Flink
• Snowflake
• Java and Python
• Amazon Web Services
• SQL and data modeling

Expected Deliverables

• Completed source code, configurations, and data models.
• Technical and operational documentation.
• Approved pull requests.
• Testing and validation evidence.
• Engineering demonstrations or technical walkthroughs.
• Release notes and change summaries.
• Production deployment artefacts.
• Post-release validation.
• Knowledge transfer and documented handoff of remaining work.

Regional Expectations

• India resources will support development, testing, and cross-time-zone delivery, with approximately three to four hours of daily overlap with the US Pacific time zone.