Azure DE

We are looking for an experienced and highly motivated Azure Data Engineer to design, develop, and optimize modern cloud-based data platforms. The ideal candidate should have strong expertise in Azure data services, Databricks, PySpark, Python, and Snowflake, with hands-on experience in building scalable ETL/ELT pipelines and modern data lakehouse architectures. Experience in Microsoft Fabric, cloud platforms (Azure and AWS), and enterprise application frameworks will be an added advantage.

Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Python.

Build and optimize ETL/ELT workflows for structured and semi-structured data from multiple source systems.

Develop robust data solutions using Azure Data Factory (ADF), Microsoft Fabric, and Azure Data Lake Storage (ADLS).

Design and implement Lakehouse and Data Warehouse solutions using Snowflake and Azure services.

Develop efficient SQL queries, stored procedures, and performance optimization techniques.

Work with large-scale distributed data processing frameworks and optimize Spark jobs.

Integrate cloud-native services across Azure and AWS environments.

Develop automation scripts using Unix Shell Scripting for deployment and operational tasks.

Collaborate with business analysts, data scientists, architects, and application teams to understand business requirements.

Participate in data modeling, data quality, governance, and metadata management initiatives.

Build reusable components, frameworks, and utilities to improve engineering productivity.

Implement CI/CD pipelines and support DevOps practices for data engineering solutions.

Monitor production pipelines, troubleshoot failures, and ensure high availability and performance.

Follow Agile/Scrum methodologies and contribute to sprint planning, estimation, and delivery.

Required Technical Skills

Cloud & Data Engineering

Microsoft Azure Data Platform

Azure Databricks

Microsoft Fabric

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS)

SnowflakeStrong analytical and problem-solving abilities.

Excellent communication and stakeholder management skills.

Ability to work independently and in cross-functional global teams.

Strong ownership, accountability, and attention to detail.

Ability to mentor junior engineers and contribute to technical excellence.