Azure Data Engineer

Azure Data Engineer - 6 to 10 YOE - Mumbai

About the Role

You contribute to the design and implementation of the Azure data platform. You develop and deploy end-to-end data applications leveraging the Azure data platform.

Responsibilities

• You contribute to the design and implementation of the Azure data platform.
• You develop and deploy end-to-end data applications leveraging the Azure data platform.
• You work with Data Architects and Platform Architects to ensure your work is aligned with aligned with the requirements and architecture.
• You work with the Security & Infrastructure teams to ensure data assets and data products are integrated and secured.
• You work independently, prioritize multiple stakeholders and tasks, and manage work time effectively.
• You participate in the definition of standards, guidelines and best practices and make sure to respect them.
• You remain up to date with latest trends and technologies and identify potential impact of market trends in your tasks.
• Developing and deploying synapse data pipelines in Azure cloud
• Analyze, develop and implement database designs, data models and logical data specifications
• Data transformation skills using the pyspark notebooks and databricks workspace/synapse spark pool.
• Code quality, security, performance measure.
• Troubleshooting and debugging.

Required Skills

• You have experience with Azure data analytics services (Data Factory, ADLS, Synapse, SQL Server, Databricks, ML).
• You are familiar with data technologies (Pyspark, python/pandas, SQL).
• You have knowledge of state-of-the-art software engineering best practices and tools (Git, CI/CD, tests, Pipelines, Bitbucket, Jenkins, Azure DevOps).
• You are familiar with Infrastructure-as-Code (Terraform).
• You have experience in handling migrations from legacy DW platforms to Azure Data Platform
• You have knowledge of SAP systems and should be able to use appropriate SAP Connectors and SAP DW experience to integrate SAP data to Azure Data Platform.
• You have Strong analytic skills related to working with unstructured datasets