Data Engineer

• Build scalable data integration solutions using IBM DataStage, Airflow, Python to move data across multiple systems.
• Write and optimize SQL queries for Oracle and MS SQL Server Database; perform data validation and quality checks.
• Develop and maintain automated workflows using Airflow. Monitor pipeline execution and troubleshoot issues.
• Write clean efficient Python scripts for data transformation, validation and integration tasks
• Tune database queries and ETL processes to ensure optimal performance and minimal latency
• Maintain comprehensive documentation of data flows, processes and provide technical support to stakeholders
• Work with data analysts, business stakeholders and other engineers to understand requirements and deliver solutions

Required Skills Must Have

• 3+ years of experience in ETL development or data engineering
• Advanced proficiency in IBM DataStage for enterprise data integration
• Strong Python programming skills for scripting and data manipulation
• Hands on experience in Airflow for workflow orchestration and scheduling
• Solid knowledge of Oracle and MS SQL Server

Preferred Skills

• Understanding of data warehousing concepts and best practices