Data Integration Engineer

Job Summary

We are looking for an experienced Data Integration Engineer with 5+ years of experience having strong hands-on expertise in SQL, IBM Unica, Pentaho ETL, and AWS. The candidate will be responsible for designing, developing, maintaining, and troubleshooting data integration pipelines and ETL processes. The role involves integrating data from multiple enterprise sources, performing data transformation and validation, supporting IBM Unica campaign/data processes, and managing data workloads on AWS. The ideal candidate should have strong analytical and troubleshooting skills and be comfortable working with large volumes of customer, policy, transaction, and campaign-related data.

Key Responsibilities

• Design, develop, and maintain ETL/data integration workflows using Pentaho.
• Develop data extraction, transformation, cleansing, validation, and loading processes.
• Write complex and optimized SQL queries for data extraction, analysis, reconciliation, and validation.
• Work extensively with IBM Unica for campaign-related data processing and integration.
• Understand IBM Unica data flows, campaign workflows, audience segmentation, and data selection processes.
• Integrate data from multiple source systems into data warehouse/data marts and downstream applications.
• Develop and maintain Pentaho Jobs and Transformations.
• Implement full-load and incremental-load ETL processes.
• Develop reusable ETL components and transformation logic.
• Perform source-to-target data mapping and implement business transformation rules.
• Perform data reconciliation and validation between source and target systems.
• Identify and resolve data-quality issues such as duplicate, missing, invalid, or inconsistent records.
• Integrate and process data using AWS cloud services.
• Monitor ETL jobs, data pipelines, and scheduled processes.
• Troubleshoot failed jobs and perform root-cause analysis.
• Optimize SQL queries, Pentaho transformations, and data-processing workflows.
• Support deployment across Development, UAT, and Production environments.
• Provide production support for critical data integration processes.
• Coordinate with Business Analysts, Data Warehouse Analysts, BI Developers, QA teams, application teams, and business stakeholders.
• Prepare and maintain technical documentation for data mappings, ETL processes, data flows, and business rules.
• AWS Data Integration

Mandatory Technical Skills

• SQL - Mandatory Strong hands-on experience in SQL with: Complex joins, Subqueries, CTEs, Stored procedures, Views, Functions, Aggregations, CASE statements, Window functions, Temporary tables, Data reconciliation, Data validation, Query optimization, Large-volume data processing; MS SQL Server / Oracle experience is preferred.
• IBM Unica - Mandatory Hands-on experience with IBM Unica is required. Candidate should have knowledge of: IBM Unica Campaign, Campaign workflow development, Audience selection and segmentation, Campaign flowcharts, Data selection and filtering, Extracting and manipulating customer data, Database integration with Unica, Campaign execution and monitoring, Troubleshooting campaign/data issues, Integration of Unica with enterprise databases, Understanding of customer and campaign data models, Experience with IBM Unica Interact will be an added advantage.
• Pentaho ETL - Mandatory Strong hands-on experience with Pentaho Data Integration (PDI/Kettle). Experience in: Pentaho Jobs, Pentaho Transformations, Data extraction, Data cleansing, Data transformation, Lookups, Joins, Aggregations, Filtering, Sorting, Data validation, Error handling, Full and incremental loads, Job scheduling, ETL monitoring, ETL performance optimization
• AWS - Mandatory / Strongly Preferred Good hands-on experience with AWS data and storage services, preferably: Amazon S3, AWS Glue, Amazon RDS, Amazon Redshift, AWS Lambda, CloudWatch, IAMAWS CLI. Experience integrating Pentaho/ETL processes with AWS data sources and storage is preferred. Data Warehousing Strong understanding of: Data Warehouse concepts OLTP vs. OLAP Staging and warehouse layers Data Marts Fact and Dimension tables Star Schema Snowflake Schema Surrogate Keys Slowly Changing Dimensions Historical data Source-to-Target Mapping Data Lineage Incremental data processing Data Integration ETL The candidate should be capable of developing complete data integration flows: Source Systems Staging Pentaho ETL Data Warehouse/Data Mart IBM Unica / BI / Reporting

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.