Data engineer

Responsibilities :

Design, develop, and implement scalable data engineering solutions using modern Big Data technologies.

Build and maintain large-scale digital platforms, marketplaces, and data-driven applications.

Work on complex engineering projects utilizing cloud-native architectures and distributed systems.

Collaborate with cross-functional teams, architects, and fellow Power Programmers to deliver innovative solutions.

Participate in end-to-end software development lifecycle activities in Agile environments.

Develop high-performance data pipelines and data processing frameworks.

Contribute to the architecture, design, coding, testing, and deployment of enterprise solutions.

Co-create new products, platforms, and technology accelerators for clients.

Engage with technology communities, open-source initiatives, and user groups.

Continuously learn and upskill on emerging technologies and industry trends.

Additional Responsibilities:

Technology-Big Data-Big Data -ALL,Technology-Big Data - Data Processing-PySpark,Technology-Big Data - Hadoop-Hadoop-Hive,Technology-Data Engineering-Databricks,Technology-Functional Programming-Scala,Technology-Java-Apache-Kafka,Technology-OpenSystem-Python - OpenSystem-Python

Technical and Professional Requirements:

Strong experience in Big Data Technologies

Hands-on expertise in: o Apache Spark o Scala o Hive o Kafka

Strong understanding of distributed data processing and data pipeline development.

Experience working with cloud platforms and cloud-native architectures.

Proficiency in software engineering best practices, design patterns, and Agile methodologies.

Strong problem-solving and analytical skills.