Azure Datafactory

Job Description:

• Join a collaborative data engineering team where your work directly powers trusted analytics and smarter business decisions
• In this role you ll build and optimize cloud based data pipelines using Azure Data Factory and Databricks helping teams move from raw data to meaningful insights with speed and reliability
• You ll partner closely with stakeholders data engineers and platform teams to understand data needs design scalable solutions and ensure smooth automated data movement across systems
• If you enjoy solving real world data challenges improving performance and bringing structure to complex datasets while working in a supportive learning focused environment this opportunity will help you grow your impact and deepen your expertise in modern Azure data platforms

Key Responsibilities:

• Key Responsibilities
• Design develop and maintain end to end data pipelines using Azure Data Factory for batch and scheduled workloads
• Build and orchestrate data transformations and processing workflows using Databricks aligned to business requirements
• Implement robust pipeline monitoring alerting and failure handling to ensure reliable and repeatable executions
• Perform data validation and reconciliation checks to ensure accuracy completeness and consistency across sources and targets
• Optimize pipeline performance by tuning ADF activities improving orchestration logic and streamlining transformations in Databricks
• Collaborate with cross functional teams to gather requirements estimate effort and deliver solutions within timelines
• Maintain technical documentation for pipelines datasets schedules dependencies and operational runbooks
• Support deployments and environment promotions by following structured release and change management practices
• Minimum Qualifications
• Education BTECH MTECH MCA MSC
• Overall experience 3 5 years in data engineering data integration roles
• Hands on experience with Azure Data Factory including pipeline development scheduling triggers and integration patterns
• Hands on experience with Databricks for data processing and transformation workflows
• Ability to troubleshoot pipeline failures analyze logs and implement corrective actions to improve stability

Technical Requirements:

• Azure Synapse Analytics Azure Data Lake Storage ADLS PySpark Delta Lake CI CD for data pipelines AZURE DATAFACTORY

Additional Responsibilities:

• Experience designing scalable orchestration patterns in ADF parameterization reusable components dependency handling
• Strong understanding of data transformation best practices and implementing efficient processing in Databricks
• Exposure to building data quality checks and operational dashboards for pipeline health and SLA tracking
• Experience collaborating with stakeholders to translate business requirements into technical pipeline designs and delivery plans
• Familiarity with performance tuning approaches for cloud data pipelines and distributed processing workloads

Preferred Skills:

Technology->Cloud Integration->Azure Data Factory (ADF)