Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 22283756

    Luxoft logo

    Senior Data Engineer

    Luxoft · Bengaluru · onsite · Posted today

    Undisclosed5–10 yrsfulltimeSourced fromNaukri

    About a minute. You'll make an account on the way through.

    About this role

    Job Summary
    This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue - a foundational shift in how one of the world's largest financial market infrastructure companies handles its data pipelines.
    During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration.
    The work is technically rich and highly collaborative: you'll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate client's rigorous internal governance - from Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision.
    This is the kind of engagement where your recommendations directly shape a multi-phase, multi-million-pound programme: the target-state framework you produce here becomes the blueprint that a larger delivery team will execute against. Perfect opportunity for combining deep data engineering knowledge with architecture leadership, stakeholder influence, and structured delivery planning inside a Tier 1 financial services environment


    Responsibilities
    • Design, build, and maintain ETL/ELT pipelines on AWS
    • Migrate existing data pipelines and workloads from legacy/on-prem systems to AWS
    • Develop and optimize data models for data warehouse/data lake (Redshift, S3)
    • Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR)
    • Implement data quality checks, validation, and reconciliation processes
    • Optimize pipeline performance and manage compute/storage costs
    • Ensure data security and access control (IAM, KMS, encryption)
    • Monitor and troubleshoot pipeline failures (CloudWatch, logging)
    • Collaborate with data analysts, BI developers, and architects on data requirements
    • Document data pipelines, architecture, and operational runbooks


    Skills

    Must have
    • 5+ years of experience
    • Hands-on experience building data pipelines on AWS (Glue, EMR, Lambda, Step Functions)
    • Strong SQL and experience with data warehousing (Redshift, dimensional modeling)
    • Proficiency in Python or Scala for data engineering
    • Experience with S3-based data lake architecture (partitioning, cataloging, formats like Parquet)
    • Experience migrating data pipelines from on-prem or other cloud platforms
    • Understanding of data governance, security, and access control on AWS
    • Experience with CI/CD for data pipelines


    Nice to have
    • AWS certification (Data Analytics Specialty or Data Engineer Associate)
    • Experience with streaming data (Kinesis, MSK/Kafka)
    • Familiarity with Infrastructure as Code (Terraform/CloudFormation)
    • Experience with orchestration tools (Airflow, dbt)
    • Experience in financial domain


    Other

    Languages
    English: C2 Proficient


    Seniority
    Senior

    Sourced from naukri

    Skills

    data qualityAws GlueData Engineercloud platformsamazon web servicesaws cloudformationapache airflowAnalyticsdata modelsAWS CloudWatchData LakeData AnalyticsData EngineeringcloudArchitectureData GovernanceData ProcessingData Pipeline

    About Luxoft

    Luxoft logo

    Luxoft

    IT Services & Consulting

    2.3k+

    employees

    2000

    26 years old

    Zug, Switzerland

    Switzerland

    About

    Luxoft offers the full spectrum of enterprise technology services, from modernizing legacy IT systems to delivering digital transformation at scale.

    Industries

    IT Services & Consulting

    Employee ratings

    832 reviews

    3.6/ 5

    Culture

    3.6

    Career growth

    2.7

    Work-life

    3.9

    Employees rate it well for

    Work Life Balance165Salary128Senior Management87Work Culture76Appraisal64

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    Senior Data Engineer · waiting for your command