Microsoft Fabric Data Engineer

Job Overview:We are looking for an experienced Microsoft Fabric Data Engineer with strong hands-on expertise in Microsoft Fabric, Azure Databricks, Azure Data Factory, data lakes, and Azure data services. The candidate will be responsible for designing, developing, and maintaining scalable data engineering solutions, building ETL/ELT pipelines, processing large datasets, and delivering reliable data platforms for analytics and business intelligence.

Roles and Responsibilities:

• Design, develop, and maintain data pipelines using Microsoft Fabric and Azure Data Factory.
• Work with Microsoft Fabric components such as Lakehouse, Warehouse, OneLake, Data Factory pipelines, and notebooks.
• Develop and optimize data transformation workflows using PySpark, Python, and SQL.
• Build and maintain ETL/ELT pipelines to ingest data from multiple sources.
• Use Azure Databricks for distributed data processing, data transformation, and large-scale analytics.
• Implement data lake solutions using Azure Data Lake Storage Gen2 and Microsoft Fabric OneLake.
• Work with Delta Lake, Lakehouse architecture, and medallion architecture (Bronze, Silver, and Gold layers).
• Integrate data from databases, APIs, files, and other enterprise data sources.
• Implement data quality checks, error handling, logging, and pipeline monitoring.
• Optimize data processing performance, query execution, and resource utilization.
• Apply data security, access control, and governance best practices.
• Collaborate with BI developers, architects, analysts, and business stakeholders to deliver trusted datasets.
• Support deployment, troubleshooting, documentation, and production data pipelines.

Mandatory Technical Skills:

• Microsoft Fabric: Lakehouse, Warehouse, OneLake, notebooks, and data pipelines.
• Azure Databricks: PySpark, Spark SQL, notebooks, and distributed data processing.
• Azure Data Factory: ETL/ELT pipeline development, orchestration, scheduling, and monitoring.
• Data Engineering: Data ingestion, transformation, data modeling, and pipeline optimization.
• Data Lakes: Azure Data Lake Storage Gen2, Delta Lake, and medallion architecture.
• Programming: Strong SQL and Python; hands-on PySpark experience.
• Azure Services: Practical experience integrating relevant Azure storage, compute, security, and monitoring services.

Preferred Skills:

• Microsoft Fabric and Azure data platform migration projects.
• Experience with CI/CD, Git, Azure DevOps, and deployment automation.
• Knowledge of dimensional data modeling and data warehousing.
• Experience with Power BI integration and analytics-ready datasets.
• Understanding of data governance, security, and access management.
• Microsoft Fabric or Azure data engineering certifications.