Specialist - Data Engineering

Role Summary Seeking an experienced Azure Databricks Engineer to design develop optimize and support scalable cloudbased data platforms using Azure Data Services The candidate will be responsible for building highperformance data pipelines implementing data engineering best practices and driving data modernization initiatives Key Responsibilities- Design and implement scalable ETLELT pipelines using Azure Databricks and Azure Data Factory Develop data processing solutions using PySpark Spark SQL and Python Build and maintain Delta Lake architectures and Databricks workflows Optimize performance of Spark jobs clusters and notebooks Implement CICD pipelines using Azure DevOps for Databricks artifacts Work with ADLS Gen2 Azure Synapse and Azure SQL for enterprise data solutions Ensure data quality governance security and compliance standards Monitor troubleshoot and support production data pipelines Collaborate with architects business stakeholders and crossfunctional teams Mentor junior engineers and participate in code reviews Mandatory Skills- Azure Databricks PySpark Apache Spark Azure Data Factory ADF Azure Data Lake Storage ADLS Gen2 SQL TSQL Python Delta Lake Databricks Workflows Azure DevOps CICD Data Modeling Git Version Control GoodtoHave Skills Delta Live Tables DLT Auto Loader Unity Catalog Azure Synapse Analytics Apache Airflow Power BI Azure Key Vault MLflow Ansible Data Governance Security Frameworks Experience 7 to 11 years of overall ITData Engineering experience 3 years of handson Azure Databricks implementation experience

Experience building enterprisescale data platforms on Azure Cloud

Preferred Certifications-

Microsoft Certified Azure Data Engineer Associate DP203

Databricks Certified Data Engineer AssociateProfessional

Azure Fundamentals AZ900

Key Competencies

Strong analytical and problemsolving skills

Stakeholder management

Technical leadership and mentoring

Agile delivery experience

Excellent communication and collaboration skills