Azure databricks + Pyspark

Role Descriptions: Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP| PIPS| POS) into WFM and UKG. 

Optimize ETLELT workflows for performance and scalability. 

Collaborate with JavaAPI developers to integrate event-driven triggers into data pipelines. 

Implement data quality checks| schema validation| and error handling. 

Support batch and near-real-time data flows for operational and analytics use cases. 

Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced. 

 Essential Skills: Strong experience with Azure Databricks (PySpark| Delta Lake). 

Proficiency in SQL and data modeling. Experience with Azure Data Lake| and Event Hub.

 Familiarity with data governance and security best practices. 

Ability to work with large datasets and optimize for performance. Familiarity with CICD (Jenkins and Terraform preferred). Knowledge of JSON| XML.