Senior Software Engineer - Python

Key Responsibilities

• Develop scalable, high performance backend applications and Distributed data pipelines using Python and PySpark
• Design and optimize complex SQL queries, stored procedures, and data models on MS SQL Server
• Leverage the Hadoop ecosystem (Hive, Hue, Impala, HBase) and Elasticsearch for high-volume data processing and search
• Implement real-time event processing using Apache Kafka
• Automate environment management and infrastructure tasks using PowerShell scripting
• Collaborate with cross-functional teams using Jira for Agile planning and Bitbucket for version control and code collaboration
• Develop, integrate, and maintain RESTful APIs within distributed systems architecture
• Participate in code reviews, contribute to technical documentation, and mentor junior engineers
• Optionally contribute to:
• Frontend development using Angular or React
• Enhancing legacy or low-code applications using VBA, Appian, or BRMS tools like Drools
• Cloud-native deployments and data pipelines on AWS or OCI (Oracle Cloud Infrastructure)

Mandatory Skills

Backend & Data Engineering

• Proficiency in Python and PySpark for backend services and data pipeline development
• Hands-on experience with Hadoop ecosystem tools: Hive, Hue, Impala, HBase
• Strong expertise in MS SQL Server – writing advanced queries, designing schemas, and implementing stored procedures
• Knowledge of Elasticsearch for distributed search and analytics
• Working knowledge of Apache Kafka for event-driven and real-time processing
• Scripting experience with PowerShell for task automation and environment configuration

Version Control & Agile Practices

• Experience using Bitbucket for source control
• Working in Agile environments using Jira for sprint planning, issue tracking, and backlog management

Software Engineering Fundamentals

• Designing and integrating RESTful APIs
• Building and maintaining distributed systems
• Active participation in code reviews and technical documentation
• Familiarity with Agile/Scrum methodologies

Optional / Preferred Skills

• Exposure to Angular or React for UI development
• Experience with Appian, VBA, or Drools (BRMS) for automation and business logic management
• Understanding of cloud platforms such as AWS or OCI
• Experience with cloud-native deployments and cloud-based data workflows
• Advanced backend development in Java and Spring Boot for microservices (a plus)

Experience & Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 7+ years of software development experience, with a focus on backend systems and data engineering
• Demonstrated success in delivering robust and scalable backend solutions
• Experience working with large-scale data platforms (e.g., Cloudera Hadoop)
• Solid understanding of software engineering principles, performance optimization, and system integration

Core Competencies

• Strong problem-solving and analytical skills
• Excellent communication and collaboration in cross-functional teams
• Ability to work independently and manage deliverables end-to-end
• Adaptability and continuous learning in dynamic environments