Senior Data Engineer – Data Stage/ETL

Job Description

Role: Senior Data Engineer – Data Stage/ETL

Location: Offshore/India

Who are we looking for

We're seeking an experienced data engineer to analyze large volume of different data set, identify the data gaps and address the same. Build automated future ready data reconciliation process in-place.

Technical Skills:

Ø Lead the Analysis of Data Sources, ETL Processes, and Databases. Identify data and process gaps, and recommend data remediation and long-term process improvements.

Ø Utilize deep expertise in various ETL tools (e.g., IBM DataStage, AWS Glue), RDBMS (e.g., DB2 zos, PostgreSQL, etc.), and different data formats (e.g., Complex XML, JSON, CSV) to drive analysis.

Ø Leverage expertise in understanding and testing REST/SOAP Integrations.

Ø Apply Python expertise to build tools for comparing data between heterogeneous sources [CSV, XML, JSON, RDBMS etc…] and automating the data validation process.

Ø Demonstrate Strong Business Acumen and Stakeholder Communication Skills.

Ø Translate complex business challenges into clear, data-driven solutions, effectively communicating technical concepts and project progress to both technical and non-technical stakeholders, including senior leadership.

Ø Act as a key liaison between the data team and business units, providing data-backed insights and recommendations that directly influence business strategy.

Ø Manage concurrent projects in a dynamic, research-oriented environment, ensuring timely delivery and high-quality outcomes.

Ø Experience in the insurance domain is preferable.

Ø AWS Data Engineer certification is good to have.

Key Responsibilities

Ø Collaborate with business units and stakeholders to document business needs, processes, reporting requirements, and challenges.

Ø Lead the design and development of robust data pipelines, utilizing deep understanding of existing ETL frameworks to build scalable and efficient solutions.

Ø Analyze and understand diverse source systems and data formats to create and validate synthetic datasets for testing and development.

Ø Develop automated data validation tools using Python to ensure data integrity across different datasets and generate comparison output reports.

Ø Ensure industry best practices are followed in all aspects of the project.

Ø Develop a robust development testing approach to minimize quality, integration, and user testing issues.

Ø Leverage generative AI to enhance data analysis, accelerate development, streamline unit testing, and improve documentation.

Ø Apply statistical analysis to large datasets, uncovering key patterns, identifying potential challenges, and generating actionable insights.

Ø Partner with business leaders to understand their challenges and provide data-driven recommendations that improve processes and inform strategic decisions.

Qualification:

Ø Somebody who has at least 8+ years of data engineering experience has played Senior Data Engineer role.

Ø Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline

Ø Education qualification: Any degree from a reputed college