Data Engineer

Role & responsibilities

3 to 6+ years of experience of Data Engineering roles including 2+ years in leading end-to-end design and implementation of data solutions for large scale use cases

• Experience in designing solutions using databases and data storage technology using Azure data management components - Azure SQL, ADLS, Cosmos
• Experience building, optimizing and automating data pipelines, architectures and data sets using MS Azure data management and processing components through IaaS/PaaS/SaaS implementation models implemented through custom solutions
• Proficiency in Python using different modules used for data munging
• Be up to date with data processing technology / platforms such as Spark (Databricks)
• Experienced in Azure DevOps
• Desirable
• Experience of working in tightly regulated industry is desirable
• Experience with ETL and/or data integration tool such as Informatica, DataStage, SSIS is highly desirable
• Good understanding of Azure infrastructure components and their fit in different types of data solutions

Preferred candidate profile