{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer - Data bricks, AWS,Redshift, Data Governance - 7th","description":"

1. 8+ years with strong Databricks, Spark and Data Migration experience

2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data Engineering, ETL Modernization, Spark Optimization and SQL-to-PySpark migration.

3. Key Responsibilities:

a) Migration Strategy and Execution: analyze the existing DWH/DB architecture, Design & Implement scalable data pipelines in Databricks, SQL Script conversion, etc.

b) Development & Optimization: Build Delta Lake tables and Implement ACID-complaint data models, Manage metadata, schema evolution and lineage for migrated datasets

c) Collaboration & Governance: Work with Data Architect to define Target data models and migration approaches, Collaborate with DevOps teams to implement CI/CD pipelines, Data Governance teams on Security, lineage and cataloging; Mentor junior members in the team

d) Nice to have experience with Unity Catalog for governance and access control; Exposure to machine learning/AI pipelines, etc.

","datePosted":"2026-06-30T00:00:00.000Z","validThrough":"2026-08-29T00:00:00.000Z","employmentType":"FULL_TIME","identifier":{"@type":"PropertyValue","name":"myjobb-ai","value":"4605552"},"url":"https://myjobb.ai/jobs/data-engineer-data-bricks-aws-redshift-data-governance-7th/4605552","directApply":false,"hiringOrganization":{"@type":"Organization","name":"Tata Consultancy Services","logo":"https://img.naukimg.com/logo_images/groups/v1/mobile/223346.gif","sameAs":"https://www.tcs.com/"},"jobLocation":[{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Kolkata","addressRegion":"West Bengal","addressCountry":"India"}}]}