Associate III - Data Engineering

Data Engineer
- Job Description
: Key Responsibilities
- Design, build, and measure ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
- Work closely with tech lead and senior engineers to implement and deliver enterprise data solutions including data strategy, feasibility and longevity of solutions, hands-on solution implementation and BAU support.
- Involve in stakeholders conversations to define multi-market data requirements and implement data and BI solutions
- Create and maintain data pipelines, integrations, and transformations to ensure efficient data processing, storage, and retrieval. Ensure data infrastructure is scalable, efficient, and aligned with best practices in data management
- Extract, organize, and manage data to ensure accessibility for authorized users across the organization
- Perform data profiling, validation, and cleansing to maintain data integrity and accuracy.
- Perform unit test and conduct reviews with other team members to ensure code is rigorously designed, elegantly coded, and effectively tuned for performance.
- Implement internal process improvements with coordination, automate manual processes, debug inefficient pipelines for optimal performance and scalability.
- Understand and follow the best practices and proactively seek opportunities to automate and construct tools that streamline operations and enhance overall reliability.
- Collaborate with business analysts to understand requirements and use cases, translating them into technical stories and tasks.

Qualifications Experience:
- 3-5 years of experience in Data Warehousing and Business Intelligence roles.
- Proficiency in Airflow Orchestration Pipelines, relational database design, data modelling, and data warehousing principles.
- Excellent programming skills in SQL, Python etc.
- Proficient in Shell scripting and building spark jobs.
- Knowledge on AWS services like S3, lambda, EMR, Cloud watch, Step functions.
- Knowledge of cloud services, relational database design principles, data warehousing, performance tuning, and optimization techniques.
- Experience in performance analysis and tuning to ensure optimal database performance
- Ability to analyze the business requirements
- Excellent communication skills with the ability to collaborate effectively with technical teams and business stakeholders to gather and refine requirements.
- Delivery-focused with a can-do attitude in challenging environments.

Other key Competencies:
- Considerable knowledge and experience of data warehousing strategies and techniques
- Experience in Vertica will be a plus
- Familiarity with agile development techniques and objectives

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.