Azure Data Engineer with MS Fabric & Claude

Job Description – Senior Azure Data Engineer withMicrosoft Fabric & Claude

Experience: 6–10 Years

Primary Skills

Azure Data Factory (ADF) | Microsoft Fabric | Claude / Claude Code | AI-Assisted Development | SQL | PySpark | Python

Position Overview

We are looking for a Senior Data Engineer with strong hands-on experience in Azure Data Factory, Microsoft Fabric, SQL, and modern data engineering practices. The candidate should also have practical exposure to AI-driven development tools such as Claude, Claude Code, GitHub Copilot, or Fabric AI capabilities to accelerate development and improve engineering productivity.

Roles & Responsibilities

1. Data Engineering & Development

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Develop data integration workflows using ADF and Microsoft Fabric Data Factory.
• Build and maintain Fabric Notebooks, Lakehouse, Data Warehouse, and Medallion Architecture solutions using PySpark and SQL.
• Analyze, transform, and integrate data from multiple sources.
• Develop and optimize complex SQL queries, stored procedures, and data models.
• Ensure data quality through validation, reconciliation, exception handling, governance, and security practices.

2. AI-Driven Engineering

• Leverage AI tools such as Claude, Claude Code, GitHub Copilot, and Fabric AI capabilities to improve productivity and accelerate software delivery.
• Apply AI-assisted coding, debugging, documentation, unit testing, and code optimization in day-to-day development.
• Utilize Generative AI to enhance data engineering workflows and automate repetitive development activities.
• Identify opportunities to integrate AI-assisted approaches into modern data engineering practices.

3. Collaboration & Delivery

• Collaborate with Solution Architects, Technical Leads, BI Developers, QA teams, Data Analysts, and business stakeholders.
• Participate in technical design, code reviews, troubleshooting, and production support.
• Translate business requirements into scalable cloud data solutions.
• Contribute to coding standards, reusable frameworks, and engineering best practices.

4. DevOps & Automation

• Implement CI/CD practices using Azure DevOps and/or GitHub.
• Automate deployment, testing, monitoring, and operational processes.
• Follow Git best practices, DataOps principles, and documentation standards.

Required Skills

• Strong hands-on experience in Azure Data Factory (ADF).
• Strong knowledge of Azure SQL Database/SQL Server, T-SQL, and Stored Procedures.
• Experience with Azure Data Lake Storage (ADLS Gen2).
• Good understanding of Microsoft Fabric and modern data engineering practices.
• Experience with Data Warehouse concepts, Fact/Dimension modeling, and Star Schema.
• Intermediate knowledge of Python and working knowledge of PySpark.
• Experience with Azure DevOps/Git and CI/CD.
• Practical exposure to AI-assisted development tools such as Claude, Claude Code, or GitHub Copilot.
• Strong analytical, problem-solving, and communication skills.

Good to Have

• Microsoft Fabric – Data Factory, Lakehouse, and Warehouse.
• Azure Logic Apps.
• Power BI Semantic Models.
• Experience with Generative AI-based automation and AI-driven engineering workflows.

Important Screening Criteria: Candidates must have practical exposure to AI-assisted development, preferably Claude or Claude Code, along with core Azure Data Engineering skills. Profiles with only traditional data engineering experience and no AI-driven development exposure should not be shortlisted.