Azure Data Engineer

Senior Azure Data Engineer

Experience: 5-10 Years
Location: Mumbai/Bangalore/Chennai/Hyderabad/Gujarat

Job Description

We are looking for an experienced Senior Azure Data Engineer with strong expertise in designing and implementing scalable data solutions using Microsoft Azure technologies. The ideal candidate should have hands-on experience with Azure Databricks, Azure Data Factory, Synapse Analytics, Python, PySpark, and Spark-based data processing.

Key Responsibilities

• Provide technical expertise in Azure Databricks and Azure Data Factory for solution design and implementation.
• Design, develop, unit test, review, and enhance data platforms and pipelines.
• Build and maintain infrastructure for data products, including data pipelines, storage systems, and processing engines.
• Develop data ingestion, curation, and transformation solutions using Spark.
• Ensure adherence to sound architecture and engineering best practices.
• Optimize data infrastructure for scalability, reliability, performance, and resource utilization.
• Minimize downtime and improve the overall efficiency of data platforms.
• Collaborate with Data Architects and Domain Data Stewards to implement solutions aligned with business requirements and Data Mesh principles.

Mandatory Skills

• Minimum 4 years of experience implementing projects using Azure technologies.
• Strong hands-on experience with Azure Databricks and Azure Data Factory.
• Experience with Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics.
• Proficiency in Python and PySpark.
• Strong experience in data ingestion, data curation, and transformation using Spark.
• Knowledge of data pipelines, storage systems, processing engines, and cloud-based data architecture.

Preferred Competencies

• Excellent verbal and written communication skills.
• Strong interpersonal and collaboration skills.
• Ability to work independently and within a team environment.
• Strong analytical and problem-solving capabilities.