Senior Software Engineer - ETL, AWS

At LPL’s Global Capability Center, you'll find a collaborative culture where your voice matters, integrity guides every decision, and technology fuels progress. Your skills, talents, and ideas will redefine what's possible. LPL's success reflects its exceptional employees, who together pursue one noble purpose: empowering financial advisors to deliver personalized advice for all who need it. We’re proud to be expanding and reaching new heights in Hyderabad. Join us as we create something extraordinary together.

Job Overview We are seeking talented and experienced Sr. Software Engineers to join the Investor Data Technology team. This role offers the opportunity to make a meaningful impact across a platform serving ~4 million users. The team is responsible for delivering high‑quality, scalable and reliable data solutions to consumers. The ideal candidate is expected to have hands‑on experience, thrives in a fast‑paced environment and is passionate about building and maintaining data‑driven platforms while collaborating with a motivated and high‑performing team.

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DocDB, PostgreSQL and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform skills for infrastructure as code.
• Ensure application security, scalability, and performance.

Requirements

• 8+ years of hands‑on experience designing and developing ETL processes and data pipelines on AWS, utilizing Glue, S3, Python, RDS/Aurora, Athena and Event Bridge.
• 8+ years of Proficiency in Python and related frameworks.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DocDB).
• Familiarity with Kafka for event-driven architectures.
• Experience using Terraform for infrastructure automation and data lake development is a plus.
• Experience with Agile Scrum methodology and tools like JIRA.
• Strong understanding of TDD and unit testing frameworks (pytest, unittest).
• 6+ years of experience with source control and CI/CD pipelines, including tools such as GitHub, TeamCity, Octopus, Jenkins, or Jules.
• Experience leveraging AI‑assisted development tools such as GitHub Copilot, Copilot Chat, Cursor, or similar technologies.

Core Competencies

• Strong verbal and written communication skills.
• Excellent analytical, estimation, and problem‑solving abilities.
• Ability to translate business needs into technical solutions.
• Proven ability to plan, prioritize, and execute in a fast‑paced environment.
• Team‑oriented mindset with a passion for continuous learning and improvement.

Preferences

• AWS Associate-level certifications (e.g., AWS Certified Developer – Associate, AWS Certified Solutions Architect – Associate).
• Additional AWS or cloud-related certifications are a plus.
• Hands-on experience with Kong API Gateway.
• Familiarity with GitHub Copilot and other AI-assisted development tools. LPL Global Business Services, LLP - PRIVACY POLICY