Data Engineer-Data Platforms-Azure

Job Description:

• Mandate-Strong Azure Data Engineer with advanced skills in Python (coding/scripting), SQL, Azure data factory, Data Modelling(Master), and Databricks (PySpark, Delta Live Tables, structured/live streaming, Unity Catalog). Handson exp in performance optimisation of DLT pipelines,cost optimization for Databricks in live streaming (Photon, serverless/nonserverless)./ ELT /data bricks Asset Bundle , ADLS.  Should have worked on huge volume unstructured data to streamline to structured.
• Role requires AI/GenAI-driven innovationleveraging LLMs/agents to accelerate automated pipeline development.(Gen AI: Genie, Mosaic AI, GitHub CoPilot - Knowledge),  Azure Functions, Logic Apps. Data Integration & Ingestion – Skill/Data Manipulation and Processing – Skill/GITHUB, Action, Azure DevOps – Skill/
• Secondary: CI/CD, Power BI/Azure Synapse, PyTest,Stream analytics,Glue,air,Kinesis,Redshift,sonarqube, Running scrum team, MKDocs Documentation
• Requires strong ownership, analytical excellence, good communication,selfdrive, and professional conduct.Role & responsibilities

Preferred candidate profile