Backend Engineer - Data Platform

Job Summary

Individual Contributor

We are seeking a talented and motivated Software Developer to join our growing team. The ideal candidate will be an expert in object-oriented programming language, possess a strong aptitude for solving Bigdata problems, and have a passion for designing and developing sophisticated Bigdata solutions. As a key member of our development team, you will contribute to the creation of innovative software solutions in the data security domain. Bengaluru.

Responsibilities

• Develop high-quality software solutions using Python/Java programming language.
• Develop high-performance data pipelines for real-time and batch processing on Lakehouse.
• Collaborate with cross-functional teams to understand project requirements and translate them into technical specifications.
• Design and implement complex, scalable, and reliable systems that meet business requirements.
• Troubleshoot, debug, and optimize pipelines on Lakehouse to ensure performance and reliability.
• Stay up-to-date with the latest industry trends, tools, and technologies.
• Work closely with DevOps to deploy and maintain applications using Docker and Kubernetes.
• Utilize cloud platforms such as AWS to build, deploy, and scale applications.
• Integrate and utilize various cloud services to enhance system functionality.

Requirements

• Energetic self-starter, with a desire to work in a startup environment.
• Experience in Bigdata processing using any of Spark, Spark Streaming, Flink, Kafka, S3 and Lakehouse - Hudi/Iceberg/DataLake.
• Proficient in advanced Java/Python programming skills.
• Should have worked for cloud based applications, built on microservices based paradigms, achieving horizontal scaling.
• Good hands on and understanding of Elasticsearch, SQL, NoSQL DB (e.g. mongoDB etc), Kubernetes.
• Good hands on in Complex Event Processing systems.
• Good to have solved scale and performance issues with respect to cloud applications.
• Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS).
• Experience developing RESTful APIs for complex data sets.
• Knowledge of container based development deployment (e.g. Dockers, rkt) Exposure to AWS, Google Cloud Platform, Microsoft Azure.
• Expertise in software security domain, a plus.

Notice

Notice: Concentric AI never asks for money nor paid certifications during the interview process; such behavior is a known scam of which we've been made aware.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.