Big Data Lead

Job Summary

Fabric - Data Engineer Key Responsibilities

Responsibilities

• Design, develop, and orchestrate end-to-end data pipelines using Microsoft Fabric.
• Build scalable and reusable data frameworks, including: Config-driven pipeline architecture.
• Centralized configuration tables supporting multiple pipelines.
• Develop and maintain Spark notebooks and pipelines.
• Implement ETL/ELT processes using SQL, Spark, and Python.
• Perform data modeling and transformations for analytics and reporting.
• Collaborate with architectural and engineering teams to design robust solutions.
• Ensure adherence to enterprise standards including: Confluence documentation CI/CD pipelines code quality and deployment guidelines.
• Support deployments across multiple client environments.
• Own deliverables end-to-end with minimal supervision.

Requirements

• Must-Have: 8+ years of experience as a Data Engineer.
• Strong experience with Microsoft Fabric (2+ years) or strong background in Azure Synapse Analytics with Azure data services (ADF, Databricks, Delta tables etc.).
• Good to have Fabric certified candidates.
• Hands-on experience with: SQL, Data Modeling, ETL / ELT Pipelines, Spark notebooks and pipelines, or Python experience for data engineering use cases.
• Create Semantic models and generate BI reports.
• Proven ability to design and orchestrate scalable data solutions.
• Experience working in environments with CI/CD processes for deployments.

Nice-to-Have

• Experience building generic or reusable data frameworks.
• Familiarity with enterprise documentation standards (e.g., Confluence).

Soft Skills

• Self-starter and quick learner.
• Strong sense of ownership and accountability.
• Ability to work independently in a fast-paced environment.
• Clear communicator with good collaboration skills.

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.