Lead Data Engineer

Job Summary

Who Were Looking For: The Lead Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems or building new solutions from ground up. This role will work with developers, architects, product managers and data analysts on data initiatives and ensure optimal data delivery with good performance and uptime metrics. Your behaviors align strongly with our values because ours.

Responsibilities

• Direct Reports: This is an individual contributor role with no direct reports
• Create, enhance, and maintain optimal data pipeline architecture and implementations.
• Analyze data sets to meet functional / non-functional business requirements.
• Identify, design, and implement data process: automating processes, optimizing data delivery, etc.
• Build infrastructure and tools to increase data ETL velocity.
• Work with data and analytics experts to implement and enhance analytic product features.
• Provide life cycle support the Operations team for existing products, services, and functionality assigned to the Data Engineering team.
• Review design documents and code to provide constructive feedback.
• Testing and deploying programs and applications.
• Constantly improve product quality, security, and performance.

Experience, Education, and Certifications

• Bachelor's degree in Computer Science, Statistics, Informatics or related field or equivalent work experience.
• 5-8 years of Software Development experience
• 3+ years of experience in Data Engineer fields.

Additional Requirements

• Familiar with Agile software design processes and methodologies.
• Experience in building and optimizing big data pipelines, architectures, and data sets.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL databases, such as PostgreSQL, MySQL, etc.
• Experience with stream-processing systems: Flink, KSQL, Spark-Streaming, etc.
• Experience with programming languages, such as Java, Scala, Python, etc.
• Experience with cloud data engineering and development, such as AWS, etc.
• Good analytic skills related to working with structured and unstructured datasets.
• Knowledge of message queuing, stream processing and scalable big data stores.
• Ownership/accountability for tasks/projects with on time and quality deliveries.
• Good verbal and written communication skills.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.