ETL Developer

Job Summary

We are looking for an experienced ETL Developer with 4+ years of experience in designing, developing, testing, and maintaining ETL/ELT processes and data pipelines. The candidate will be responsible for extracting data from multiple source systems, transforming and cleansing data according to business requirements, and loading it into Data Warehouses/Data Marts. The ideal candidate should have strong hands-on experience in SQL, ETL development, data transformation, data validation, data warehousing, and performance optimization. Experience with Pentaho and Insurance/BFSI domain will be an added advantage.

Responsibilities

• Design, develop, and maintain robust ETL/ELT workflows and data pipelines.
• Extract data from multiple sources including relational databases, files, APIs, and other enterprise systems.
• Develop transformation logic based on business and technical requirements.
• Load transformed data into Data Warehouse, Data Mart, or reporting databases.
• Develop reusable and scalable ETL components.
• Work closely with Business Analysts, Data Warehouse Analysts, BI Developers, QA teams, and business stakeholders.
• Understand source-to-target mapping and implement appropriate transformation rules.
• Perform data cleansing, standardization, validation, and reconciliation.
• Develop and maintain Source-to-Target Mapping (STTM) specifications.
• Implement data-quality checks and exception-handling mechanisms.
• Monitor scheduled ETL jobs and troubleshoot failures.
• Analyze ETL errors and perform root-cause analysis.
• Optimize ETL workflows and SQL queries for improved performance.
• Manage dependencies between ETL jobs and downstream reporting processes.
• Support SIT, UAT, and Production deployments.
• Perform data reconciliation between source and target systems.
• Prepare technical documentation for ETL workflows, mappings, transformations, and data flows.
• Support production issues and provide timely resolution.
• Follow coding, naming, version-control, and deployment standards.

Mandatory Technical Skills

• ETL
• Strong hands-on experience in one or more ETL tools: Pentaho Data Integration (PDI / Kettle) - preferred; Informatica; SSIS; Talend; Azure Data Factory
• Experience developing: ETL transformations, Jobs and workflows, Data pipelines, Lookups, Joins, Filters, Aggregations, Data cleansing, Error handling, Incremental data loads, Full and incremental load mechanisms

Data Warehousing

• Good understanding of: Data Warehouse architecture
• OLTP vs. OLAP
• Staging layer
• Data Warehouse
• Data Mart
• Fact and Dimension tables
• Star Schema
• Snowflake Schema
• Surrogate Keys
• Primary and Foreign Keys
• S slowly Changing Dimensions (SCD)
• Historical data management
• Incremental loading
• Full loading
• Data partitioning
• ETL Performance Optimization
• Identify and resolve ETL bottlenecks
• Optimize ETL workflows for large-volume data processing
• Optimize SQL queries used within ETL processes
• Minimize unnecessary data movement and transformations
• Implement appropriate indexing and partitioning strategies
• Optimize lookup and join operations
• Handle large-volume and incremental data loads efficiently
• Monitor ETL execution time and resource utilization

Data Quality Reconciliation

• Implement data validation and quality checks
• Validate source-to-target record counts
• Perform data reconciliation between source and target
• Identify duplicate, missing, incorrect, or inconsistent data
• Validate transformation logic and business rules
• Maintain exception/error records for failed or rejected data
• Support investigation and resolution of data-quality issues

Database Skills

• Experience with one or more: Microsoft SQL Server, Oracle, MySQL, PostgreSQL, DB2
• Strong understanding of database concepts, relationships, indexes, constraints, views, stored procedures, and query performance

Cloud Modern Data Engineering - Good to Have

• Azure Data Factory
• Azure Synapse Analytics
• Microsoft Fabric
• Azure SQL
• Azure Data Lake
• Databricks
• Snowflake
• AWS Glue
• AWS Redshift

Insurance / BFSI Domain - Preferred

• Experience in Insurance / BFSI is highly preferred.
• Exposure to insurance-related datasets such as: Policy, Customer / Life Assured, Agent, Premium, Claims, Renewal, Commission, Product, Policy transactions, Sales, Financial reporting
• Experience supporting enterprise reporting, MIS, regulatory reporting, or analytics platforms will be an advantage

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.