Manager - Azure Databricks - MosaicAI

Role & responsibilities

Responsibilities

- Designing and implementing scalable data infrastructure and systems to support efficient data processing and analysis
- Developing and managing data pipelines, integration, and transformation solutions using Azure Databricks and other data engineering platforms
- Leading teams in the strategic planning and execution of data-driven projects, confirming alignment with client expectations
- Utilizing advanced technologies such as Apache Hadoop and Apache Airflow to enhance data processing capabilities
- Overseeing the deployment and optimization of data warehouses, confirming data quality and security
- Collaborating with business and technology leaders to identify and address data challenges and opportunities
- Mentoring team members to develop their skills and encourage innovation in data engineering practices
- Validating data integrity and compliance within analytics frameworks to support informed decision-making
- Promoting the use of cloud-based analytics platforms like Snowflake and AWS for enhanced insights generation
- Encouraging a culture of continuous learning and development within the team to adapt to evolving data technologies

What You Must Have

- At least a Bachelor's degree
- At least 8+ years of experience
- Oral and written proficiency in English required

What Sets You Apart

- Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
- Demonstrating proficiency in Microsoft Azure Databricks and Snowflake platforms
- Utilizing advanced data engineering techniques for complex data transformations
- Excelling in strategic planning and execution within data modernization projects
- Leading teams in agile environments to deliver data-driven solutions
- Mentoring junior staff to enhance their data engineering capabilities
- Embracing technology and innovation to drive client success

Preferred candidate profile