Azure Data Engineer

Desired Competencies (Technical/Behavioral Competency)

Must-Have

• Min 6+ years experience in implementing projects in Azure stacks
• Experience with Azure Databricks, Data Factory
• Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
• Experience in Python PySpark
• Experience in data ingestion, curation and transformation using spark

Good-to-Have

• Excellent verbal and written communication and interpersonal skills
• Ability to work independently and within a team environment.

Responsibility of / Expectations from the Role

1 Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation

2 Design, code, unit test, and code review iterative improvements to platform

3 Ensure adherence to sound architecture

4 Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines.

5 Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime.

6 Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.