Senior Data Engineer- Full time/Freelancing

Senior Data Engineer

Role: Senior Data Engineer
Experience: 8+ Years
Location: Hyderabad
Employment Type: Full-Time/Freelancing

Job Summary:

We are looking for an experienced Senior Data Engineer with strong hands-on experience in Microsoft Fabric, PySpark, Spark SQL, and SQL. The candidate should have experience building scalable data pipelines and working with Azure data services, Lakehouse architecture, and modern data engineering technologies.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Microsoft Fabric / Azure Data Factory.
• Work with PySpark, Spark SQL, SQL, and Azure SQL for data processing and transformation.
• Build and maintain data solutions using Microsoft Fabric Lakehouse and Delta tables.
• Integrate data from Kafka, Oracle, REST APIs, and ADLS.
• Implement data models using Star Schema and Snowflake Schema.
• Work with Power BI datasets and semantic models and integrate them with Microsoft Fabric.
• Perform data quality checks, performance tuning, and basic data security.
• Use Git and CI/CD workflows for development and deployment.
• Collaborate with data, analytics, and business teams to deliver reliable data solutions.

Required Skills:

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Microsoft Fabric.
• Good knowledge of PySpark and Spark SQL.
• Strong SQL skills, including Azure SQL.
• Experience with Fabric or Azure Data Factory pipelines.
• Hands-on experience with Kafka, Oracle, REST APIs, and ADLS.
• Knowledge of Lakehouse architecture and Delta tables.
• Understanding of Star Schema / Snowflake Schema and data modeling.
• Working knowledge of Power BI, datasets, and semantic models.
• Experience with Git and basic CI/CD.
• Knowledge of data quality, performance tuning, and security basics.

Preferred Skills:

• Exposure to Azure Databricks or Azure Synapse.
• Experience with Azure DevOps.
• Knowledge of streaming / near real-time data pipelines.
• Experience handling semi-structured data such as JSON and API data.

Candidate Profile:

Candidates with strong Microsoft Fabric + Data Engineering experience and hands-on expertise in PySpark, Spark SQL, SQL, Azure, and data pipelines are preferred.