Senior Data Engineer (Python, Airflow)

KPI Partners is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines and ETL processes to support our data analytics capabilities. You will work closely with data scientists, analysts, and other stakeholders to ensure data quality and accessibility. Your expertise in Python and Apache Airflow will be essential in managing workflows and automating data processes.

Key Responsibilities: 
- Design, develop, and maintain robust and scalable data pipelines to process large datasets. 
- Collaborate with cross-functional teams to gather requirements and ensure the integration of data solutions aligned with business needs. 
- Optimize ETL processes for performance and efficiency, ensuring timely data delivery for analytics and reporting. 
- Monitor, troubleshoot, and improve data workflows using Airflow, ensuring reliability and scalability. 
- Implement data quality checks and validations to maintain the integrity and accuracy of data. 
- Document data processes and architectures for reference and knowledge sharing. 
- Stay current with industry trends and best practices in data engineering and analytics.

Skills and Tools Required: 
- Proficiency in Python for data processing and automation. 
- Strong experience with Apache Airflow for workflow management. 
- Familiarity with SQL and relational databases (e.g., PostgreSQL, MySQL). 
- Knowledge of cloud platforms such as AWS, Azure, or GCP. 
- Understanding of data modeling and data warehousing concepts. 
- Experience with ETL tools and technologies. 
- Strong analytical and problem-solving skills. 
- Excellent communication skills and the ability to work collaboratively in a team environment. 

Preferred Qualifications: 
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. 
- Experience with big data technologies (e.g., Hadoop, Spark) is a plus. 
- Familiarity with data visualization tools (e.g., Tableau, Looker) is beneficial. 
- Previous experience in a fast-paced and agile work environment. 

KPI Partners offers competitive compensation, benefits, and opportunities for professional growth. If you are passionate about data engineering and eager to make an impact, we encourage you to apply.