Big Data Hadoop

We are seeking an experienced Data Engineer (Big Data Hadoop) to join our team and contribute to the design development and optimization of large scale data platforms The ideal candidate should have strong expertise in Big Data technologies realtime data processing distributed computing and modern data engineering practices The role requires working closely with business stakeholders solution architects data scientists and engineering teams to build scalable and high performance data solutions

Key Responsibilities:
Design develop and maintain enterprise scale data ingestion and processing pipelines
Develop batch and streaming solutions using Hadoop Spark Kafka and NiFi
Build scalable ETL/ELT frameworks to process structured semistructured and unstructured data
Design and implement realtime data streaming solutions using Kafka and Spark Streaming
Develop data integration workflows using Apache NiFi
Optimize data processing jobs for performance scalability and reliability
Collaborate with Data Architects and Data Modelers to implement data models and platform architecture
Implement data quality reconciliation monitoring and governance frameworks
Troubleshoot production issues and perform root cause analysis
Ensure adherence to security compliance and data governance standards
Participate in code reviews architectural discussions and technical design activities