EY - GDS Consulting - AI And DATA -AI Data Platform Engineer

Role Experience Guide Primary Skill Area The opportunity Your key responsibilities

• Microsoft Fabric Data Engineering
  • Design and implement Fabric data solutions using OneLake, Lakehouse, Warehouse, Data Factory Pipelines, Dataflows, Notebooks, Spark, SQL endpoints, and Power BI semantic models.
  • Build reusable ingestion and transformation frameworks for batch, event-driven, API-based, file-based, and enterprise application integration patterns.
  • Develop curated data products across raw, standardised, trusted, and consumption layers with quality, lineage, and operational controls.
  • Optimise pipeline performance, workspace usage, refresh patterns, capacity consumption, and downstream analytics readiness.
• Fabric Azure Platform Engineering
  • Create reusable platform standards for workspace onboarding, deployment pipelines, item naming, logging, monitoring, semantic model patterns, and support runbooks.
  • Implement Git connectivity, branching strategy, pull requests, code reviews, CI/CD, Fabric REST API automation, and environment promotion.
  • Integrate Fabric with Azure Data Lake Storage, Event Hubs, Functions, Key Vault, Azure DevOps, Azure Monitor, Microsoft Purview, Synapse, Databricks, and enterprise APIs.
  • Support platform administration, release management, governance readiness, and production operations.
• AI, Copilot Agentic Enablement
  • Enable Fabric Copilot, AI-ready data products, semantic models, RAG-ready datasets, metadata-driven automation, and conversational analytics use cases.
  • Support AI integration across Power BI, semantic layers, enterprise search, GenAI assistants, and downstream data consumers.
  • Apply agentic operations for schema drift detection, failed pipeline summarisation, root-cause recommendation, data quality anomaly detection, and automated documentation.
• Governance, Security Data SRE
  • Implement Entra ID, workspace roles, item permissions, sensitivity labels, lineage, auditability, Key Vault integration, masking/security patterns, and controlled access.
  • Integrate with Microsoft Purview, Immuta, Collibra, IAM, monitoring services, data quality tools, and enterprise access workflows.
  • Build Data SRE dashboards for Fabric capacity, workspace usage, pipeline failures, refresh performance, data quality, cost, access activity, and SLA/SLO adherence.

Skills and attributes for success

• Core platform: Microsoft Fabric, OneLake, Lakehouse, Warehouse, Data Factory Pipelines, Dataflows, Notebooks, Spark, Power BI semantic models.
• AI and GenAI: Fabric Copilot, AI-ready data products, semantic models, RAG, enterprise search, metadata automation, Agentic AI.
• Engineering: Python, PySpark, SQL, APIs, Git, CI/CD, Delta/Parquet, unit testing, integration testing, data pipeline testing.
• Azure and DevOps: Azure DevOps, Entra ID, Key Vault, Event Hubs, Functions, Azure Monitor, Purview, ADLS, deployment pipelines, policy-as-code.
• Governance and reliability: Purview, Immuta, sensitivity labels, lineage, audit, masking/security patterns, data quality, observability, Data SRE, FinOps.

To qualify for the role, you must have

• 5-10 years of experience in data engineering, data platform operations, analytics engineering, platform engineering, or AI platform enablement.
• Strong hands-on implementation experience with cloud data platforms, APIs, Git connectivity, CI/CD, governed access patterns, SRE practices, and production operations.
• Preferred certifications aligned to the relevant cloud/platform stack, data engineering, DevOps, security, governance, and AI/ML engineering.

Ideally, you'll also have

• Strong hands-on engineer with architecture awareness, delivery ownership, and a platform engineering mindset.
• Comfortable turning platform standards into reusable frameworks, secure implementation patterns, operational controls, and production-ready services.
• Able to mentor engineers, collaborate with architects/security/SRE teams, and adopt newer AI-native and agentic engineering methods.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.