Senior Data Engineer

POSITION: Reltio MDM Developer

LOCATION: Chennai/Hyderabad/Bangalore- Hybrid.

DURATION: Full Time.

Notice Period: Immediate joiner/ Serving notice less than 45 days

Must have skills (Hand's on)

Azure Synapse Analytics- 3 years

Pyspark- 4+ years

Python- 1+ years

Fabric- 6+ months

This is a migration project from Azure Synapse Analytics to Fabric

Experience: 8+ Years

Job Summary

We are seeking a highly skilled Senior Data Engineer to join the Data Cloud team supporting client. The ideal candidate should possess strong data engineering expertise with hands-on experience in Python, Azure Synapse Analytics, Microsoft Fabric, Databricks, and modern cloud-based data platforms.

The candidate should be capable of independently designing, developing, optimizing, and supporting scalable data solutions while working closely with business and technical stakeholders.

Key Responsibilities

• Analyze business requirements and design scalable data engineering solutions.
• Design, develop, and maintain robust data pipelines and ETL/ELT frameworks.
• Build and optimize data ingestion, transformation, and processing workflows using Python and PySpark.
• Develop data solutions using Azure Synapse Analytics, Microsoft Fabric, and Databricks.
• Implement scalable data lake and data warehouse architectures.
• Develop reusable, metadata-driven, and parameterized data pipelines.
• Perform complex data transformations, aggregations, joins, and data quality validations.
• Optimize pipeline performance and troubleshoot data processing issues.
• Implement monitoring, logging, and error-handling frameworks.
• Work with structured and semi-structured data sources across cloud and on-premise platforms.
• Support production incidents, root cause analysis, and performance tuning activities.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Participate in code reviews and follow engineering best practices.

Required Skills

• Strong Python programming experience
• PySpark
• Azure Synapse Analytics
• Microsoft Fabric
• Databricks
• SQL
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Delta Lake
• Data Warehousing Concepts
• ETL / ELT Development
• Data Modeling
• CI/CD and DevOps practices
• Performance Optimization and Troubleshooting

Preferred Experience

• Banking or Financial Services domain experience
• Regulatory reporting and analytics platforms
• Medallion Architecture (Bronze, Silver, Gold)
• Large-scale cloud data migration and modernization projects

Key Expectations

• Strong engineering and problem-solving capabilities
• Ability to work independently with minimal supervision
• Experience handling complex data transformation and integration scenarios
• Strong debugging, troubleshooting, and optimization skills
• Excellent communication and stakeholder management skills