Lead Fabric Data engineer

• Design, develop, and implement scalable data engineering solutions using Microsoft Fabric and OneLake.
• Build and maintain end-to-end data pipelines using Fabric Data Factory, Pipelines, and Dataflows Gen2.
• Develop data ingestion and transformation processes across structured and semi-structured data sources.
• Implement Medallion Architecture (Bronze, Silver, and Gold) using Fabric Lakehouse.
• Develop and optimize PySpark/Spark notebooks for large-scale data processing and transformation.
• Design and implement data models and curated datasets for analytics and reporting.
• Develop solutions using Fabric Data Warehouse and T-SQL for analytical workloads.
• Work with Delta Lake and optimize storage, partitioning, and data processing strategies.
• Implement incremental data loads, slowly changing dimensions, data quality checks, and error-handling frameworks.
• Integrate data from multiple sources including Azure, SQL Server, APIs, files, and legacy data platforms.
• Optimize pipeline performance, Spark workloads, SQL queries, and Fabric capacity utilization.
• Implement and maintain CI/CD pipelines, Git integration, and deployment processes for Fabric artifacts.
• Work with Azure DevOps/GitHub to manage source code, releases, and development workflows.
• Implement appropriate data security, access controls, and workspace-level governance.
• Collaborate with Power BI developers and analytics teams to provide optimized datasets and Semantic Models.
• Troubleshoot production issues, perform root-cause analysis, and ensure timely resolution.
• Participate in architecture discussions, code reviews, technical design sessions, and solution walkthroughs.
• Mentor junior and mid-level data engineers and promote data engineering best practices.
• Ensure solutions meet performance, scalability, reliability, security, and data quality standards.

• 68 years of experience in Data Engineering, Data Development, or related data technology roles.
• 2+ years of hands-on experience with Microsoft Fabric or strong experience in Azure data platforms with practical Fabric implementation experience.
• Strong hands-on experience with Microsoft Fabric and OneLake.
• Expertise in Fabric Data Factory, Data Pipelines, Dataflows Gen2, Lakehouse, and Data Warehouse.
• Strong experience with PySpark/Spark and Python for large-scale data processing.
• Strong proficiency in SQL/T-SQL and experience developing complex queries and transformations.
• Good understanding of Delta Lake and Medallion Architecture.
• Experience implementing Bronze, Silver, and Gold data layers.
• Strong understanding of ETL/ELT development and data integration patterns.
• Experience working with structured and semi-structured data sources.
• Hands-on experience with Azure Data Factory and/or Azure Synapse Analytics is preferred.
• Experience with Power BI and Semantic Models is an added advantage.
• Knowledge of Direct Lake and Fabric performance optimization is preferred.
• Experience with Git, Azure DevOps, CI/CD, and Fabric deployment pipelines.
• Good understanding of data security, access controls, data governance, and workspace management.
• Experience with data quality, monitoring, logging, and production support.
• Strong analytical and problem-solving skills.
• Good communication and collaboration skills.
• Ability to work independently as well as lead and mentor technical team members.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.