Data Engineer - Microsoft Fabric / Azure

Location: Remote
Posted On: 1 day ago
Experience Required: 5+ Years Experience

Saguna Consulting partners with organizations to transform bold ideas into scalable, long-lasting solutions through a blend of strategy, technology, and execution. With a human-centered and outcome-driven approach, Saguna collaborates with product-led teams, founders, and enterprises to deliver practical, intuitive, and impactful solutions. From early-stage concepts to production-ready platforms, the company acts as a trusted advisor, builder, and long-term partner.

We are looking for a Data Engineer to own the data platform layer end to end on Microsoft Fabric — from source system ingestion through to curated Gold Delta tables. You will build the Lakehouse, land data incrementally, and deliver a clean, well-modelled Gold layer that the reporting layer sits on top of. This is a hands-on delivery role on enterprise client engagements.

Key Responsibilities:

• Set up Microsoft Fabric workspaces and Lakehouse architecture with Silver (landing) and Gold (curated) layers, including access and capacity configuration.

• Build ingestion pipelines from Databricks Gold / summary tables, SQL Server and CSV / flat file sources using Fabric Data Pipelines, Dataflow Gen2, Notebooks (PySpark / Spark SQL) or OneLake shortcuts.

• Design and implement incremental load frameworks using watermark columns or primary key MERGE, so that each run moves only changed records instead of transferring full history.

• Convert CSV / flat file sources currently joined at refresh time into governed, scheduled Delta tables.

• Build transformation, source integration, null handling and data quality logic in the Gold layer.

• Perform Delta table maintenance — OPTIMIZE, V-Order, VACUUM, partitioning — to keep downstream Direct Lake models performing.

• Carry out discovery activities: source inventory, dependency mapping and current-state refresh baselining.

• Monitor pipelines, handle failures, and maintain runbook and handover documentation.

• Coordinate closely with the Power BI developer on Gold layer table structure, grain and shape.

• Deploy through Deployment Pipelines with Git integration.

What we Require:

• 4+ years of hands-on experience in Data Engineering.

• Hands-on Microsoft Fabric experience — Lakehouse, OneLake, Notebooks, Data Pipelines, Dataflow Gen2. Strong Azure Synapse or Databricks background with demonstrated Fabric ramp-up will also be considered.

• Advanced SQL, and Python / PySpark for notebook-based transformation.

• Solid understanding of Delta Lake internals — MERGE, schema evolution, time travel, file compaction and layout.

• Practical experience in incremental load design — CDC, watermarking and upsert patterns.

• Understanding of how Gold layer design affects Power BI semantic model performance.

• Ability to work directly with client teams for requirement gathering and status discussions.

• Good written and verbal English communication.

Preferred Attributes:

• Databricks Unity Catalog, mirroring or shortcut-based integration with OneLake.

• Azure DevOps / GitHub CI-CD for Fabric artifacts.

• Azure networking basics — private endpoints, gateways.

• Spark performance tuning.

• Microsoft certification DP-700 or DP-203

• Data Engineer

• Microsoft Fabric 

• Lakehouse , One Lake , Delta Lake

• Pyspark

• SQL 

• Dataflow Gen2 , Data Pipelines , Databricks

• Azure Data Factory , Azure Synapse

• Incremental Load , ETL , Data Modelling , Spark , Data Warehousing

Would you like to grow forward together?