Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Apache Flink, Spark, Kafka and SQL.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop high-quality APIs for IoT device integration and ensure seamless data flow between systems.
• Troubleshoot complex issues related to big data processing, streaming analytics, and machine learning models.

Job Requirements :

• 6-11 years of experience in a similar role as a Data Engineer or Software Engineer with expertise in Big Data technologies such as Apache Flink, Spark, Kafka etc.
• Strong proficiency in programming languages like Python or Java along with experience working on cloud platforms like AWS or GCP.
• Experience with API integration using tools like Airflow or equivalent is required. Knowledge of SQL database management systems is essential.