Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy, and maintain large-scale data pipelines using Apache NiFi to extract, transform, and load (ETL) data from various sources into a centralized repository.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through ETL processes.
• Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and availability.
• Ensure high-quality delivery of projects by implementing automated testing frameworks such as Apache Flink or Kafka.

Job Requirements :

• 5-10 years of experience in Data Engineering with expertise in Apache NiFi.
• Strong understanding of big data technologies like Hadoop ecosystem (HDFS), Spark (Scala/Python), NoSQL databases (e.g., MongoDB).
• Proficiency in writing complex SQL queries for querying relational databases (e.g., MySQL).
• Experience working on Agile development methodologies with version control systems like Git.