Data Engineer

Role & responsibilities

Job Description: Azure Data Engineer (4+ Years Experience)

Experience Required: 4+ years of relevant experience in Data Engineering on Microsoft Azure Cloud

Job Summary

We are seeking a skilled Azure Data Engineer with hands-on experience in designing, developing, and maintaining scalable data solutions on the Azure cloud platform. The ideal candidate should have strong expertise in Azure Databricks, PySpark, Python, SQL, and Azure Data Factory, with experience building enterprise-grade data pipelines and data lakehouse architectures.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure services.
• Build and optimize data processing solutions using Azure Databricks, PySpark, and Spark SQL.
• Develop and manage Azure Data Factory (ADF) pipelines for data ingestion, orchestration, and monitoring.
• Implement data lake solutions using Azure Data Lake Storage (ADLS Gen2) and Delta Lake.
• Perform data transformation, cleansing, validation, and enrichment for analytics and reporting.
• Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.
• Work with structured, semi-structured, and unstructured data from multiple source systems.
• Collaborate with business stakeholders, solution architects, and data analysts to understand requirements and deliver data solutions.
• Implement data quality, governance, security, and monitoring best practices.
• Support CI/CD deployment processes using Azure DevOps.

Required Skills

Technical Skills

• Azure Databricks
• PySpark / Apache Spark
• Python
• SQL
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS)
• Delta Lake
• Azure Synapse Analytics
• Azure SQL Database
• Data Warehousing Concepts
• ETL / ELT Development
• Performance Tuning and Optimization
• Git / Azure DevOps

Preferred candidate profile

Good to Have

• Medallion Architecture (Bronze, Silver, Gold)
• Unity Catalog
• Structured Streaming
• Azure Key Vault
• Azure Monitor & Log Analytics
• Microsoft Fabric
• CI/CD implementation for Data Engineering projects

Perks and benefits

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• Microsoft Azure certifications (AZ - 900, DP-900) are preferred.
• Databricks certifications are an added advantage.