Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract insights from various sources such as PostgreSQL databases.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop scalable data processing workflows using Apache Flink or PySpark on AWS cloud platform.
• Ensure high-quality data delivery by implementing robust testing frameworks and monitoring dashboards in Snowflake.

Job Requirements :

• 6-10 years of experience in Data Engineering with expertise in Airflow, Apache Flink, Python (PySpark), PostgreSQL, SQL.
• Strong understanding of big data technologies like Hadoop ecosystem (HDFS) and Spark (Scala).
• Experience working with cloud-based platforms like AWS for deploying applications.