MS Fabric

Key Responsibilities

Design, develop, and orchestrate end-to-end data pipelines using Microsoft Fabric

Build scalable and reusable data frameworks, including:

Config-driven pipeline architecture

Centralized configuration tables supporting multiple pipelines

Develop and maintain Spark notebooks and pipelines

Implement ETL/ELT processes using SQL, Spark, and Python

Perform data modeling and transformations for analytics and reporting

Collaborate with architectural and engineering teams to design robust solutions

Ensure adherence to enterprise standards including:

Confluence documentation

CI/CD pipelines

Code quality and deployment guidelines

Support deployments across multiple client environments

Own deliverables end-to-end with minimal supervision

Required Skills & Experience

Must-Have

8+ years of experience as a Data Engineer

Strong experience with Microsoft Fabric (2+ years of work experience in Fabric)

OR strong background in Azure Synapse Analytics with Azure data services (ADF, Databricks, Delta tables etc.)

Good to have Fabric certified candidates

Hands-on experience with:

SQL

Data Modeling

ETL / ELT Pipelines

Experience with Spark notebooks and pipelines or Python experience for data engineering use cases

Create Semantic models and generate BI reports

Proven ability to design and orchestrate scalable data solutions

Experience working in environments with CI/CD processes for deployments

Nice-to-Have

Experience building generic or reusable data frameworks

Familiarity with enterprise documentation standards (e.g., Confluence)

Soft Skills

Self-starter and quick learner

Strong sense of ownership and accountability

Ability to work independently in a fast-paced environment

Clear communicator with good collaboration skills