Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 16738697

    M-League logo

    Data Engineer

    M-League · Bengaluru · onsite · Posted 72d ago

    Not disclosed2–6 yrsfulltimeSourced fromInstahyre

    About a minute. You'll make an account on the way through.

    About this role

    The candidate will have responsibilities across the following functions:


    Data Warehousing and Modelling:

    • Own the design of silver/gold layer tables: grain, join keys, schema, partitioning, and clustering decisions for large-scale datasets.
    • Build and maintain batch and streaming ETL pipelines (using big data technologies) feeding the medallion architecture.
    • Design idempotent, observable pipelines with QC gates, backfill strategies, and clear failure semantics.
    • Standardise data models and conventions across multiple game products/projects.
    • Deliver high-quality data pipelines with utmost importance to correctness and availability of the data to different target audiences/systems.


    Design Decisions and Technical Ownership:

    • Lead source-system profiling and drive grain, deduplication, and enrichment decisions backed by data, not assumptions.
    • Own trade-off calls: cost vs. freshness, load strategy, schema evolution, and query/slot optimisation.
    • Document designs and decisions so they survive beyond the author.


    Stakeholder Management:

    • Partner with analysts, PMs, and game teams to translate business questions into warehouse requirements and reconcile instrumentation gaps.
    • Communicate design proposals and data profiling findings to both technical and leadership audiences.


    Requirements:

    • Experience: 2+ years in data engineering, with deep data warehousing exposure at scale.
    • SQL and BigQuery: Expert-level SQL; hands-on BigQuery optimisation (partitioning, clustering, slots, cost).
    • Data Modelling: Strong command of medallion architecture, dimensional/fact modelling, grain definition, and schema design.
    • Programming: Production-grade Python; PySpark on Dataproc (or Databricks/EMR equivalents).
    • Streaming: Working experience with Kafka-based ingestion (Confluent preferred).
    • Data Quality: Experience building validation, observability, and reconciliation into pipelines.
    • Stakeholder Skills: Proven ability to gather requirements, challenge assumptions, and communicate trade-offs clearly.
    • Education: Bachelor's/Master's in CS, Engineering, or related field (or equivalent experience).


    AI-Augmented Engineering (Must-Have):

    • We expect AI tooling to be part of your daily workflow, with sound judgment on when to trust and when to verify:
    • Hands-on daily use of AI coding agents Claude Code / CLI, Claude web app, or equivalents (Cursor, Copilot, Gemini CLI).
    • Experience creating reusable AI assets: custom skills/commands, prompt libraries, or repo-level agent context.
    • Familiarity with MCP or similar integrations connecting agents to warehouses and internal tools.
    • Ability to demonstrate real examples of AI-accelerated work and where you drew the human-review line.


    Preferred:

    • LLM-in-pipeline experience: AI-driven data quality checks, anomaly triage, or text-to-SQL for self-service analytics.
    • Broader GCP: Pub/Sub, Cloud Run, Cloud Functions, Cloud SQL.
    • Gaming, fintech, or other high-volume consumer event domains.

    Sourced from instahyre

    Skills

    PythonSQLData WarehousingSnowflakeETL

    Data Engineer · waiting for your command