SAP BW

Job DescriptionJoin a high-impact data engineering team where youll lead the design and modernization of enterprise analytics solutions by blending strong SAP BW expertise with scalable Databricks and PySpark capabilities. In this role, youll work closely with business stakeholders, architects, and cross-functional engineering teams to deliver trusted datasets, performant pipelines, and actionable insights. Youll be empowered to shape technical direction, mentor team members, and drive best practices across development, testing, and deployment. If you enjoy solving complex data challenges, improving reliability and performance, and enabling data-driven decision-making at scale, this opportunity offers the right mix of leadership, hands-on engineering, and collaborative ownership in a fast-moving environment.
Roles ResponsibilitiesKey Responsibilities:

Lead end-to-end delivery of data engineering solutions leveraging Databricks and PySpark for scalable processing and transformation.

Design, build, and optimize batch/near-real-time pipelines with strong focus on performance, cost efficiency, and reliability.

Collaborate with SAP BW stakeholders to understand source models, data semantics, and reporting needs; translate them into modern data platform designs.

Develop reusable frameworks, coding standards, and best practices for Spark-based development and notebook/job orchestration.

Ensure data quality through validations, reconciliation checks, and robust error handling/monitoring across pipelines.

Drive technical discussions, estimate work, plan sprints, and manage delivery risks/dependencies for the team.

Mentor engineers, conduct code reviews, and enforce secure, maintainable, and well-documented implementations.

Partner with platform/DevOps teams to support CI/CD, environment management, and production readiness for Databricks workloads.


Minimum Qualifications:

Bachelors or Masters degree (BTECH, MTECH, MCA, MSC) in Computer Science, Engineering, or a related field.

79 years of overall experience with strong hands-on expertise in Databricks and PySpark for large-scale data processing.

Strong experience working with SAP BW concepts and data structures to support analytics/reporting requirements.

Solid understanding of data modeling, ETL/ELT patterns, and performance tuning in distributed data processing environments.

Ability to lead technical delivery, collaborate with stakeholders, and communicate clearly across teams.
Technical RequirementTechnology->Business Intelligence - Reporting->SAP BW
Additional ResponsibilityPreferred Qualifications:

Experience modernizing or integrating SAP BW data with cloud-based lakehouse architectures using Databricks.

Strong knowledge of Spark optimization techniques (partitioning, caching, joins, file sizing) and production-grade pipeline design.

Exposure to Delta Lake patterns (ACID tables, MERGE, time travel) and building curated layers for analytics consumption.

Experience with workflow orchestration and operational monitoring for data pipelines, including alerting and SLA management.

Proven ability to guide teams through design reviews, code quality improvements, and delivery governance in agile environments.
Educational RequirementMCA,MSc,MTech,Bachelor of Engineering,BTech
Preferred SkillsTechnology->Business Intelligence - Reporting->SAP BW
Service LineData Analytics Unit