Senior Software Engineer, Data Platform

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Data Platform based in India.

This is an exciting opportunity for a senior software engineer to build and operate the foundational data systems that power modern business applications. In this role, you will design scalable data platforms, improve pipeline reliability, and develop tools that enable engineering and analytics teams to work more efficiently. You will contribute to real-time and batch data processing solutions while solving complex challenges around scalability, performance, and data quality. Working in a technically advanced environment, you will have ownership over critical infrastructure and the opportunity to apply AI-driven automation to improve engineering workflows. If you are passionate about distributed systems, data engineering, and building reliable platforms at scale, this role offers the chance to make a significant impact.

Accountabilities: Design, build, and operate scalable data ingestion and transformation pipelines supporting both real-time and batch workloads.

Develop reliable solutions for onboarding new data sources, managing integrations, and evolving existing data platform capabilities.

Contribute to the architecture and development of core data platform components, including storage, compute, and pipeline infrastructure.

Build automation tools for monitoring, alerting, data quality measurement, and self-service capabilities.

Diagnose and resolve production issues by identifying root causes and implementing long-term systemic improvements.

Participate in on-call rotations by managing incidents, driving resolution, and contributing to post-incident improvements.

Develop and leverage AI-powered agents to automate engineering and operational workflows, including monitoring, troubleshooting, triage, and support processes.

Collaborate with engineering and analytics teams to deliver reliable, scalable, and high-quality data solutions.

Requirements

7+ years of experience in software engineering or data engineering roles within production-scale, high-traffic environments.

Proven experience building and maintaining batch and real-time data pipelines.

Strong understanding of distributed systems concepts, including scalability, reliability, fault tolerance, and performance optimization.

Strong ownership mindset with the ability to take responsibility for systems throughout their lifecycle.

Hands-on experience with streaming technologies such as Kafka or similar platforms.

Experience with Spark Structured Streaming and open table formats such as Apache Iceberg, Delta Lake, or Hudi.

Experience working with cloud data warehouses, with Snowflake experience strongly preferred.

Familiarity with workflow orchestration tools such as Airflow or similar solutions.

Strong proficiency in Python and SQL.

Ability to build and use AI agents for engineering and operational tasks, including automation tools, runbooks, and support workflows.

Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience.

Experience with CDC patterns and tools such as Debezium, DBT or transformation frameworks, and big data technologies like Spark, Flink, or Pinot is a plus.

Familiarity with AI coding tools or LLM-based agent frameworks is considered an advantage.

Benefits

Full-time remote opportunity for candidates based in India.

Opportunity to work on large-scale data platforms and technically challenging engineering problems.

Build systems that support critical business operations and high-volume data workflows.

Work with modern technologies across distributed systems, cloud data platforms, streaming, and AI automation.

High level of ownership and impact within a collaborative engineering environment.

Opportunities for continuous learning, technical growth, and career development.

Flexible remote work culture focused on trust, innovation, and collaboration.

Inclusive environment that values diverse perspectives and encourages new ideas.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether?    Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.     #LI-CL1