Data Engineers - Databricks - Senior Associate

Role & responsibilities

Responsibilities

- Designing and developing Databricks-based data pipelines, transformations, and integration workflows for client data environments
- Building and maintaining data infrastructure that supports reliable processing, storage, and access across analytics solutions
- Applying data engineering methods to model, cleanse, validate, and organize structured and semi-structured data
- Analyzing complex data challenges and translating business needs into technical design choices
- Using Apache Airflow, Azure Data Factory, and cloud data platforms to schedule, automate, and monitor pipeline execution
- Tuning performance across data processing jobs, query logic, and warehouse workloads to improve execution efficiency
- Supporting data architecture decisions across lake, warehouse, and platform design patterns
- Interpreting data requirements and technical feedback to refine solution design and delivery workstreams
- Collaborating with client teams and internal stakeholders to align data solutions with broader project objectives
- Guiding junior team members on data engineering tasks, technical methods, and delivery activities

What Sets You Apart

- Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
- Demonstrating Databricks data engineering experience in client service workstreams
- Utilizing Apache Airflow, Azure Data Factory, or equivalent orchestration tools
- Applying data modeling, transformation, and validation in modern pipelines
- Interpreting data insights and recommendations for stakeholders
- Navigating ambiguity while mentoring junior team members
- Collaborating across teams to anticipate client and project needs