Senior Gen AI Data Engineer

Responsibilities

• Developes, maintains, and tests infrastructures for data generation.
• Creates and maintains optimal data pipeline archictecture and assembles data to meet business needs.
• Assembles large, complex datasets that meet functional / nonfunctional business requirements.
• Identifies, designs, and implements internal process improvements; automates manual processesprocesses, optimizing data delivery and redesigning infrastructure for greater scalability.
• Builds infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies.
• Works with stakeholders including the Executive, Product, Data, and Design teams to assist with datarelated technical issues and support data infrastructure needs.
• Keeps data separated and secure across national boundaries through multiples data centers and AWS regions.
• Creates data tools for analytics and data scientist team members that that assist with building and optimizing products into innovative, industry leaders.
• Oversees data generation infrastructure.
• Builds analytics tools to provide actionable insights and assist data science and analytics team members with building bestinclass products.
• Work with stakeholders to assist with datarelated tech issues and support data infrastructure needs.
• Applies advanced knowledge of sub-function typically obtained through advanced education and work experience.
• Responsibilities may include: Managing products, systems and/or projects/processes, and working independently with limited supervision.
• Facing IT function related problems that are sometimes difficult and moderately complex.
• Coaching and reviewing the work of lower-level professionals.

Qualifications

• University Degree and minimum 5 years of prior relevant experience, or equivalent experience.
• Preferred: SQL Python, Azure data factory, Data; Bricks, Spark (experience would be a plus) Data transformation Cloud Data Experience Distributed data warehouse knowledge Data Lakes

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.