MS Fabric Data Engineer

Role Overview: We are looking for a Senior Data Engineer with strong expertise in Microsoft Fabric, Medallion Architecture, Data Modelling, Governance, Python, and AI Integration. The role focuses on architecting enterprise-grade analytics and reporting solutions, implementing scalable data engineering practices, and enabling AI-powered business intelligence capabilities within Microsoft Fabric. Job Responsibilities 1. Power BI & Microsoft Fabric Architecture ● Architect enterprise-grade reporting solutions using Microsoft Fabric Direct Lake mode and Medallion Architecture. ● Eliminate data latency through optimized data layer design and pipeline architecture. ● Optimize complex DAX queries and SQL queries to improve report rendering performance significantly. ● Design and implement scalable semantic data models that accelerate team report development. ● Ensure all reporting architecture is aligned with enterprise governance and performance standards. 2. Advanced Report Development & AI Integration ● Design interactive, user-centric Power BI reports tailored to business stakeholders — translating complex requirements into intuitive UI designs. ● Train and deploy custom Fabric AI Agents to enable ad-hoc data queries within reports. ● Enable self-service analytics capabilities that reduce dependency on support teams. ● Integrate AI-powered features within the reporting layer to enhance business decision-making. 3. Governance & CI/CD ● Spearhead collaborative development using Power BI Projects (.PBIP) and Git Integration for version control and conflict resolution. ● Orchestrate deployments across Dev / QA / UAT / Prod environments using Fabric Deployment Pipelines and ALM Toolkit. ● Manage semantic model metadata and diffs across deployment stages. ● Enforce enterprise governance via Row-Level Security (RLS), Object Level Security (OLS), and Dataset Endorsement (Certified / Promoted). 4. Automation & Data Engineering ● Automate QA processes using Python (SemPy) in Fabric Notebooks to validate data lineage and quality. ● Integrate Power Automate to trigger real-time alerts based on semantic model thresholds. ● Proactively notify users and stakeholders of critical data anomalies. ● Develop PySpark and Spark SQL notebooks within Microsoft Fabric for scalable data transformations. ● Optimize data models for seamless and performant reporting.