LEAD DATA ENGINEER - Azure Data Factory

Senior Data Engineer - Analytics & BI

Mandatory Skills

Azure Data Factory,Azure Databricks,SQL Server,and Power BI

Skill to Evaluate

and Power BI,Azure Data Factory Developer,Databricks Engineer,Pyspark,SQL Server Development

Experience

8 to 10 Years

Location

Bengaluru

Job Description

We are looking for a Senior Data Engineer with strong hands-on experience in Azure data platforms, particularly Azure Data Factory, Azure Databricks, SQL Server, and Power BI . The candidate should have a good understanding of end-to-end data architecture across ingestion, processing, and reporting layers. The role involves contributing to complex implementations, ensuring best practices, and mentoring junior team members.

Education Qualificaiton

Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, Data Science, or a related field.

Job Title

Senior Data Engineer - Analytics & BI

Roles & Responsibilities

Key Responsibilities:

Design, develop, and manage end-to-end data pipelines using Azure Data Factory (ADF) for efficient ETL/ELT processes.

Develop, deploy, and monitor scalable data solutions using Azure Synapse Analytics / Databricks to support large-scale data processing and analytics.

Write optimized SQL Server scripts, stored procedures, and views to support data transformation and integration requirements.

Build and maintain insightful dashboards and reports using Power BI , with a focus on usability, performance, and clear data communication.

Develop automation scripts using PowerShell for operational and monitoring tasks across Azure services.

Create automated workflows using Power Automate to streamline manual tasks and notifications.

Leverage Python / PySpark for data manipulation, transformation, and orchestration within Synapse or Databricks environments.

Collaborate with business stakeholders, data analysts, and application developers to gather requirements and deliver high-quality solutions.

Perform root cause analysis, data validation, and ensure data integrity across systems and processes.

Mentor junior engineers and participate in code reviews, design discussions, and documentation efforts to ensure best practices and knowledge sharing.

Ensure security, compliance, and governance in all data engineering activities.

Required Skills and Qualifications:

8-10 years of experience in data engineering, data analytics, or business intelligence roles.

Strong proficiency in Azure Data Factory , SQL Server , and Power BI .

3+ years of hands-on experience with Azure Synapse Analytics or Databricks and Python for data transformation and analysis.

Experience with PowerShell scripting for automation and Power Automate for workflow integration.

Strong understanding of data warehousing concepts, data modelling, and performance tuning.

Excellent analytical and problem-solving abilities.

Strong communication skills and ability to effectively engage with both technical and non-technical stakeholders.

Preferred Qualifications (Nice to Have):

Experience with Azure Data Lake Storage (ADLS) and Delta Lake .

Knowledge of DevOps , CI/CD pipelines , and version control systems (e.g., Git).

Familiarity with data governance , security best practices , and compliance standards .

Exposure to Agile methodologies and working in cross-functional teams.

Type of Employment

Contract

Project Details

Global EUSP DWH Platform: A centralized data platform serving as a single source of truth for M365 tenant data, enabling reporting, analytics, and automation capabilities for global stakeholders.

Project Duration

Long term

Shift Timings

13:30 to 22:30 IST