Sr. Data Engineer

We are seeking a highly skilled Senior Data Engineer to join the Data Cloud team supporting a client. The ideal candidate should possess strong data engineering

expertise with hands-on experience in Python, Azure Synapse Analytics, Microsoft Fabric, Databricks, and modern cloud-based data platforms. The candidate should be capable of independently designing, developing, optimizing, and supporting scalable data solutions while working closely with business and technical stakeholders.

Responsibilities:

• Analyze business requirements and design scalable data engineering solutions.
• Design, develop, and maintain robust data pipelines and ETL/ELT frameworks.
• Build and optimize data ingestion, transformation, and processing workflows using Python and PySpark.
• Develop data solutions using Azure Synapse Analytics, Microsoft Fabric, and Databricks.
• Implement scalable data lake and data warehouse architectures.
• Develop reusable, metadata-driven, and parameterized data pipelines.
• Perform complex data transformations, aggregations, joins, and data quality validations.
• Optimize pipeline performance and troubleshoot data processing issues.
• Implement monitoring, logging, and error-handling frameworks.
• Work with structured and semi-structured data sources across cloud and on-premises platforms.
• Support production incidents, root cause analysis, and performance tuning activities.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Participate in code reviews and follow engineering best practices.

Requirements:

• Strong Python programming experience.
• Skills include PySpark, Azure Synapse Analytics, Microsoft Fabric, Databricks, SQL, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Delta Lake, Data Warehousing Concepts, ETL / ELT Development, Data Modeling, CI/CD and DevOps practices, Performance Optimization and Troubleshooting.

Preferred Experience:

• Banking or financial services domain experience.
• Regulatory reporting and analytics platforms.
• Medallion Architecture (Bronze, Silver, Gold).
• Large-scale cloud data migration and modernization projects.

Key Expectations:

• Strong engineering and problem-solving capabilities.
• Ability to work independently with minimal supervision.
• Experience handling complex data transformation and integration scenarios.
• Strong debugging, troubleshooting, and optimization skills.
• Excellent communication and stakeholder management skills.