Data Engineer-Senior II

Job Summary

Responsible for developing, optimize, and maintaining business intelligence and data warehouse systems, ensuring secure, efficient data storage and retrieval, enabling self-service data exploration, and supporting stakeholders with insightful reporting and analysis.

Grade - T5

Please note that the Job will close at 12am on Posting Close date, so please submit your application prior to the Close Date

Responsibilities

• Data Pipeline - Develop and maintain scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity
• Data Integration - Connect offline and online data to continuously improve overall understanding of customer behavior and journeys for personalization. Data pre-processing including collecting, parsing, managing, analyzing and visualizing large sets of data
• Data Quality Management - Cleanse the data and improve data quality and readiness for analysis. Drive standards, define and implement/improve data governance strategies and enforce best practices to scale data analysis across platforms
• Data Transformation - Processes data by cleansing data and transforming them to proper storage structure for the purpose of querying and analysis using ETL and ELT process
• Data Enablement - Ensure data is accessible and useable to wider enterprise to enable a deeper and more timely understanding of operation.

Qualifications & Specifications

• Masters /Bachelor s degree in Engineering /Computer Science/ Math/ Statistics or equivalent.
• Strong programming skills in Python/Pyspark/SAS.
• Proven experience with large data sets and related technologies - Hadoop, Hive, Distributed computing systems, Spark optimization.
• Experience on cloud platforms (preferably Azure) and its services Azure Data Factory (ADF), ADLS Storage, Azure DevOps. Hands-on experience on Databricks, Delta Lake, Workflows.
• Should have knowledge of DevOps process and tools like Docker, CI/CD, Kubernetes, Terraform, Octopus.
• Hands-on experience with SQL and data modeling to support the organizations data storage and analysis needs.
• Proficiency in enterprise data pipeline and ETL tools such as Ab Initio, Informatica, DataStage, or equivalent technologies
• Experience on any BI tool like Power BI (Good to have).
• Cloud migration experience (Good to have)
• Cloud and Data Engineering certification (Good to have)
• Working in an Agile environment
• 4-7 years of relevant work experience needed.
• Experience with stakeholder management will be an added advantage.

What we are looking for

Education: Bachelors degree or equivalent in Computer Science, MIS, Mathematics, Statistics, or similar discipline. Masters degree or PhD preferred.

Knowledge, Skills and Abilities

• Fluency in English
• Analytical Skills
• Accuracy & Attention to Detail
• Numerical Skills
• Planning & Organizing Skills
• Presentation Skills
• Data Modeling and Database Design
• ETL (Extract, Transform, Load) Skills
• Programming Skills

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.