Senior Databricks Data Engineer (AWS,Airflow)

KPI Partners is seeking a highly skilled Senior Databricks Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Databricks, AWS, and Apache Airflow, and will play a critical role in designing, developing, and maintaining our data processing pipelines and architectures.

Key Responsibilities:

- Design and implement scalable data processing solutions using Databricks on AWS.
- Develop and maintain ETL processes using Apache Airflow.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
- Optimize data workflows and ensure efficient data storage and retrieval practices.
- Monitor and troubleshoot complex data workflows and pipelines in a production environment.
- Stay current with industry trends and best practices in data engineering and cloud technologies.
- Document processes, architectures, and code to ensure project continuity and knowledge sharing.

Qualifications:

- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Strong expertise in Databricks and AWS services (such as S3, Redshift, Lambda, etc.).
- Proficiency in using Apache Airflow for workflow orchestration.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Excellent programming skills in languages such as Python or Scala.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Effective communication skills and the ability to work collaboratively in a team.

Benefits:

- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance.
- Retirement savings plan with company matching.
- Opportunities for professional development and continuous learning.
- A supportive and inclusive work culture that values innovation and collaboration.

Join KPI Partners and be part of a team that is dedicated to delivering high-quality data solutions that drive business success. If you are passionate about data engineering and want to make an impact, we invite you to apply.