Data Engineer 2

Job Summary

• We are seeking a Full Stack Data Engineer P2 who is a self-starter to work in a diverse and fast-paced environment as part of our Enterprise Data team
• This individual contributor role is responsible for designing and developing end-to-end data solutions - from cloud data pipelines through APIs to the applications that consume them - that are strategic to the business and built on the latest technologies and patterns
• This is a global role that requires partnering with the broader JLLT team at the country, regional, and global levels by utilizing in-depth knowledge of data, infrastructure, technologies, data engineering, and modern application development

Responsibilities

• Design, develop, and maintain scalable and efficient cloud-based data infrastructure using SQL and PySpark
• Design and implement efficient data pipeline frameworks, ensuring the smooth flow of data from various sources to data lakes, data warehouses, and analytical platforms
• Build and operate secure, well-documented REST APIs and microservices that expose curated data products to downstream applications
• Develop responsive, accessible web interfaces dashboards, data exploration tools, and internal applications that make engineered data usable to business stakeholders
• Collaborate with cross-functional teams to understand data requirements, identify potential data sources, and define data ingestion architecture
• Troubleshoot and resolve issues related to data processing, data quality, data pipeline performance, and application behavior
• Stay updated with emerging technologies, tools, and best practices in cloud data engineering, SQL, PySpark, and modern web application development
• Collaborate with data scientists, analysts, product managers, and other stakeholders to understand requirements and deliver solutions that meet their needs
• Document data infrastructure, data pipelines, ETL processes, API contracts, and application architecture, ensuring knowledge transfer and smooth handovers
• Create complex automated tests across data, service, and UI layers and integrate them into testing frameworks

Requirements

Education & Experience:

• Bachelors degree in Computer Science, Data Engineering, Software Engineering, or a related field (Masters degree preferred)
• Minimum 3-5 years of experience in data engineering and full-stack development, with a focus on cloud-based environments
• Demonstrated experience shipping at least one production application end to end from data ingestion through API to user interface

Technical Skills

• Strong expertise in managing big data technologies (Python, SQL, PySpark, Spark) with a proven track record of working on large-scale data projects
• Strong Databricks experience
• Strong experience in designing and implementing data pipelines, ETL processes, and workflow automation
• Strong database/backend testing with the ability to write complex SQL queries for data validation and integrity
• Strong streaming and real-time API/service validation including automation
• Proficiency building REST APIs and microservices, including experience with automated web services (WSDL) and microservices (REST) using custom scripts and assertions for data validation and data-driven testing
• Working proficiency with a modern JavaScript/TypeScript front-end framework (React preferred) including component architecture and state management
• Solid command of HTML, CSS, and responsive layout, with awareness of accessibility standards (WCAG)
• Experience with data visualization libraries (e.g., D3, Recharts, Plotly) or BI embedding
• Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Proficiency in object-oriented programming and software design patterns
• Experience working in DevOps model, including installing, configuring, and integrating automation scripts on continuous integration tools (CI/CD) and GitHub for real-time test suite execution and troubleshooting
• Experience with Unit, Functional, Integration, User Acceptance, System, and Security testing of data pipelines and web applications
• Familiarity with data warehousing concepts, dimensional modeling, data governance best practices, and cloud-based data warehousing platforms (e.g., AWS Redshift, Google BigQuery, Snowflake)
• Familiarity with containerization and deployment patterns (e.g., Docker, Kubernetes, serverless)
• Familiarity with cutting-edge AI technologies and demonstrated ability to rapidly learn and adapt to emerging concepts and frameworks

Core Competencies

• Strong problem-solving skills and ability to analyze complex data processing and application issues
• Ability to reason across layer boundaries - diagnosing whether an issue originates in the pipeline, the service, or the interface
• Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams
• Attention to detail and commitment to delivering high-quality, reliable data solutions
• Ability to adapt to evolving technologies and work effectively in a fast-paced, dynamic environment

Location

On-site - Bengaluru, KA

Scheduled Weekly Hours

• 40

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.