IN_Senior Associate – AWS Data Engineer – Data and Analytics – Advisory – Bangalore

Job Description & Summary:

We are looking for an experienced AWS Data Engineer with strongexpertisein SQL, Python, andPySparkto design, build, andoptimizescalable data ingestion and ETL/ELT pipelines. The role requires hands-on experience with AWS services such as Glue, Step Functions, Lambda, and DMS, along with a strong understanding of data engineering best practices, production readiness, and high-volume data processing.

Responsibilities:

• Develop ETL/ELT pipelines using AWS services such as Glue, Step Functions, Lambda, and DMS.

• Implement direct-to-Aurora ingestion strategies for snapshots and delta loads.

• Ensure referential integrity, correct processing order, idempotency, and recovery mechanisms.

• Build monitoring, validation, and reconciliation frameworks for production data pipelines.

• Manage scalability and throughput during high-volume EOD ingestion workloads.

Mandatory skill sets:

• Expert-level SQL development and performance optimization.

• Strongproficiencyin SQL, Python, andPySpark.

• Hands-on experience with ETL pipelines and orchestration frameworks.

• Solid understanding of ACID-compliant data ingestion principles.

• Experience with schema evolution and CDC (Change Data Capture) patterns.

• Experience owning production readiness and end-to-end solution delivery.

• Exposure to cloud-native architectures and AWS tools such as Glue, Step Functions, Lambda, and DMS.

Preferred skill sets:

• Experience with SAP ODP or enterprise data replication technologies.

• Familiarity with distributed PostgreSQL systems.

• Exposure to event-driven architectures such as Kafka.

Years of experiencerequired:

Experience:5-8 years

• Minimum 3 years of relevant work experience, typically reflecting 5+ years in data engineering, data integration, or related roles.

• Proventrack recordof building resilient and idempotent ingestion frameworks.

• Experience supporting high-volume, time-sensitive processing, especially EOD workloads.

• Strong operational mindset, including monitoring, alerting, andmaintainingrunbooks.

BE, B.Tech, ME, M.Tech, MBA, MCA or equivalent qualification preferred