Senior Data Engineer | Emerging Products

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer | Emerging Products based in United States.

This role offers the opportunity to shape the future of enterprise data infrastructure by building scalable platforms that power analytics, machine learning, and next-generation products. The Senior Data Engineer will design and implement modern lakehouse architectures, streaming systems, and high-performance data pipelines. Working with advanced technologies such as Kafka, Spark, Airflow, Iceberg, and Databricks, this position focuses on solving complex distributed data challenges. The role combines hands-on engineering with architectural decision-making to create reliable, efficient, and scalable data solutions. You will collaborate closely with data scientists, analysts, and product teams to transform business needs into impactful data capabilities. This is a remote-friendly opportunity for an experienced data professional looking to influence platform strategy and engineering excellence.

Accountabilities:: The Senior Data Engineer will be responsible for designing, developing, and optimizing a modern data platform that supports large-scale analytics and product innovation. The role focuses on building reliable data infrastructure, improving platform performance, and enabling teams across the organization to make data-driven decisions.

Design and implement scalable lakehouse architectures using structured data layers, including Bronze, Silver, and Gold patterns.

Build and maintain high-performance streaming and batch data pipelines using technologies such as Kafka, Spark, and Airflow.

Develop and manage open table format solutions, including Iceberg, Delta Lake, and Hudi, selecting the appropriate approach based on workload requirements.

Optimize distributed query environments and analytics platforms to improve performance, scalability, and reliability.

Manage data platform reliability by monitoring pipeline health, troubleshooting data quality issues, and implementing continuous improvements.

Architect and maintain solutions supporting hybrid streaming and batch processing environments.

Partner with data scientists, analysts, and product teams to understand requirements and deliver effective data platform capabilities.

Create and maintain Gold-layer datasets optimized for business intelligence and self-service analytics.

Contribute to platform standards, engineering best practices, and the evolution of enterprise data infrastructure.

Requirements:

The ideal candidate is an experienced data engineering professional with deep expertise in distributed systems, modern data architectures, and scalable platform development. This role requires strong technical skills, architectural judgment, and the ability to collaborate with cross-functional teams to deliver reliable data solutions.

Bachelor’s degree in Computer Science, Computer Engineering, Information Technology, or equivalent professional experience preferred.

10+ years of experience in data engineering, with significant experience building enterprise-scale data platforms.

Proven experience designing and implementing lakehouse architectures and Medallion data models.

Strong hands-on expertise with Apache Kafka, Apache Spark, and Apache Airflow for streaming and batch workloads.

Advanced knowledge of open table formats such as Apache Iceberg, Delta Lake, or Hudi.

Experience working with Databricks for large-scale data processing and analytics.

Strong programming skills in Python and SQL.

Experience with distributed query engines such as Trino or Starburst is a plus.

Knowledge of event-driven architectures and hybrid streaming/batch systems.

Strong understanding of data modeling, performance optimization, and scalable pipeline design.

Excellent communication skills with the ability to collaborate effectively across technical and business teams.

Must be a U.S. citizen or lawful permanent resident due to security requirements.

This position is not eligible for visa sponsorship.

Benefits:

The role provides a competitive compensation package and benefits designed to support professional growth, financial security, and work-life balance.

Competitive base salary range of $110,000–$200,000 USD annually , depending on location, experience, skills, and market factors.

Fully remote work flexibility within eligible U.S. locations, with hybrid options available in select office locations.

Comprehensive medical, dental, and vision insurance coverage.

401(k) retirement plan to support long-term financial planning.

Life insurance coverage.

Unlimited paid time off to support work-life balance.

Opportunities for career growth, advancement, and professional development.

Collaborative and supportive work environment focused on innovation and continuous learning.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether?    Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.     #LI-CL1