Data Engineer -Kolkata - 8th Sep (Tuesday)-8+Years- Video Interview

Senior Data Engineer

Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica

Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables • Solid experience with Python, SQL, YAML, and Terraform • Hands-on experience in building and optimizing scalable data pipelines • Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling • Knowledge of CI/CD practices and data governance tools like Purview or Informatica

Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables.

2 Implement ETL processes across diverse data assets ensuring data quality and performance.

3 Develop and manage data warehouses and lakehouses for structured and semi-structured data.

4 Ensure compliance with data security, governance, and privacy standards using Purview and Informatica.

5 Collaborate with data scientists and ML engineers to operationalize machine learning pipelines.

6 Implement CI/CD pipelines for automating data pipeline deployments.

7 Translate complex technical solutions into business insights for stakeholders.

8 Troubleshoot and resolve performance bottlenecks in data workflows.