Data Engineer

Key Responsibilities

• Design and develop Fabric Pipelines for automated ingestion from APIs, files into OneLake.
• Implement medallion architecture (Bronze Silver Gold) using Fabric Lakehouses and Warehouses, applying Delta Lake best practices, partitioning, and incremental load patterns.
• Build dimensional (star schema) models in the Gold layer aligned to Student, Finance, HR, Learning, and Advising domains.
• Develop and maintain the master orchestration framework, including dependency management, retry logic, error handling, and scheduled execution windows.
• Implement data quality checks, validation rules, and reconciliation logic across layers; support certification of enterprise KPIs.
• Configure Row-Level Security (RLS) and Object-Level Security (OLS) in collaboration with the BI and security teams.
• Integrate with Microsoft Purview for metadata capture, lineage, classification, and business glossary alignment.
• Support deployment pipelines across Dev Test Prod Fabric workspaces, including CI/CD via Git integration.
• Collaborate with NWTC technical data stewards during sprint ceremonies, UAT, and hypercare.
• Produce technical documentation: source-to-target mappings, pipeline runbooks, and operational handover materials.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5+ years of data engineering experience, with at least 2 years building on Microsoft Fabric, Azure Synapse, or Azure Data Factory.
• Hands-on expertise with OneLake, Lakehouse, Delta Lake, and Fabric Pipelines / Dataflows Gen2.
• Strong SQL and PySpark / Spark SQL skills for large-scale transformation workloads.
• Proven experience implementing medallion architecture and dimensional (Kimball-style) modeling.
• Working knowledge of Power BI semantic models, DirectLake/Import modes, and dataset refresh orchestration.
• Experience with source system integration patterns: REST APIs, OData, file-based ingestion, and CDC.
• Familiarity with Microsoft Purview, Entra ID, and Fabric workspace security models.
• Strong written and verbal communication; comfortable working directly with client stakeholders.