Sr. Data Engineer

Job Description

As a Senior Data Engineer, you'll architect and build the critical data infrastructure that powers our intelligent platform. You'll own the orchestration layer connecting ad channels, website engagement data, and eCommerce platforms, ensuring data flows seamlessly, context is preserved, and insights drive action. You'll work across the full data lifecycle from ingestion and transformation to delivery and monitoring while building scalable systems that serve our ML and product teams. You'll join an existing data engineering team and collaborate closely with ML engineers, product teams, and customers to build reliable data pipelines that power real business outcomes. Responsibilities: - Build orchestration layers that manage data flows across the eCommerce ecosystem. - Maintain context for intelligent summarization and action design data models and systems that preserve business context, enabling the right insights at the right time for autonomous agents and human decision-makers. - Own end-to-end data engineering solutions using Airflow, Python, and GCP services from design through deployment and monitoring. - Extend and optimize existing data infrastructure work with current ingestion tools (Supermetrics) while building custom pipelines where needed. - Plan and execute future pipeline modernization; identify opportunities to improve scalability, reliability, and maintainability of existing systems. - Shape the future of data engineering at Out of the Blue by bringing ideas on automation, optimization, and best practices. Requirements: - 5-8 years of experience building production data pipelines. - Strong coding skills in Python with expert-level SQL. - Experience with workflow orchestration using Airflow or similar tools. - Hands-on experience with GCP (BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc. ) - Understanding of data modeling for analytics and ML use cases. - Passion for code quality: you write maintainable, well-documented, testable code. - Experience with eCommerce platforms (Shopify, BigCommerce) and their data models. - Knowledge of adtech/martech ecosystem, tracking pixels, attribution, and ad platform APIs. - Experience with stream processing technologies (Kafka, Pub/Sub, and Dataflow). - Familiarity with agent-based approaches for data orchestration and quality monitoring. - Understanding of ML pipelines and feature engineering for production ML systems. - Experience with data quality frameworks and observability tools (Great Expectations, Monte Carlo, etc. ) - Background in reverse ETL and data activation use cases. Company Summary Out of the Blue is an AI-driven insights platform that helps identify patterns in the data that are affecting KPIs and metrics. It raises alerts to material metric movement (behavior changes) that help organizations take corrective actions in time. This frees up analysts and enables them to focus on running business. Think of us as insurance that machine intelligence is watching over your business. We want to help create the intelligence once promised and never delivered in Business Intelligence software. In short, our mission is to help data-driven professionals leapfrog the grunt-work of tedious, repetitive, and incomplete data explorations to answer the fundamental what and why questions that animate organizations. The seasoned founding team at Out of the Blue has lived experiences working at companies like Google, eBay and PayPal and degrees from Stanford, Berkeley, and Booth. Backed by premier Silicon Valley VCs, we're re-imagining how teams wield data to drive decisions. We want to automate away the boring parts of analytics and put the intelligence back into Business Intelligence. Why Join Us We believe diversity and perspective drives innovation and we're building a culture where you drive meaningful action and difference is valued. As a member of the team you'll have the opportunity to build this culture with us. The founding engineering team will shape this entire architecture from scratch backed by a strong product design aesthetic. This is as early ideation and creation phase of a startup as it gets - as autonomous as it gets - as FUN as it gets - if you thrive on the energy of creating something out of nothing!

Required Skills

[ETL]

Additional Information

NA