Azure Data Engineer

Role & responsibilities

• Lead and mentor junior data engineers
• Design, build and deploy ELT pipelines and data management processes.
• Operationalise ELT job workflow with reliable error/exception handling and rollback framework.
• Build and oversee data architecture & pipelines platforms and systems, managing the flow of data from internal and external sources by leveraging both distributed and local structures.
• Participate in developing, designing, configuring, and documenting database architecture.
• Monitor and improve data loading performance.
• Working with CI/CD pipelines to manage and execute releases
• Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project
• Conform to agile development practices Evolutionary design, refactoring, continuous integration/delivery, test-driven development.
• Work collaboratively with Business Partner Team and Business Stakeholder during projects scoping and feasibility phases as a SME for concept investigation/viability and technical impact; Identify and communicate technical risks and mitigations.
• Provide production support for data load jobs.
• Write customized query to generate automatic periodic reports.
• Maintain or upgrade existing applications.

Attend key design meetings and provide support.

Preferred candidate profile