Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Cloudera Data Platform

Good to have skills : NA
Minimum 7.5 year(s) of experience is required

Educational Qualification : 15 years full time education

Summary:
We are seeking a highly experienced Assistant Manager/Manager with strong expertise in Big Data platforms Management. The ideal candidate will lead the design, development, and operational support of enterprise-scale of HDFS / Ozone.
This role requires deep technical knowledge of Cloudera Hadoop ecosystem and provides solutions, combined with leadership skills to manage engineering teams and collaborate with cross-functional stakeholders.

Job Title: Assistant Manager/Manager Cloudera Administrator

Roles Responsibilities:
1. Production Support Incident Management
Manage batch scheduling
Investigate and resolve: Application failures Query aborts/long running Services down Lost Nodes Memory errors
Perform root cause analysis (RCA) and implement preventive solutions.
Coordinate with application teams for issue resolution.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.

2. Stakeholder Management
Manage sprint deliverables and engineering tasks using Agile methodologies.
Collaborate with: Data architects BI developers Data scientists Data governance teams Business stakeholders
Drive automation, operational efficiency, and engineering best practices.
Enforce coding standards, version control, and release management processes.

Professional Technical Skills:
8+ Years (Minimum 2+ years in Team Lead / Support role)
1. Scripting Automation
Proficiency in Unix/Linux and Shell scripting

2. Data Warehousing
Strong understanding of: Star Schema Snowflake Schema Fact and Dimension modeling Development lifecycle management
3. Preferred Skills
Familiarity with version control tools (Git / SVN).
Experience with Oozie or Cron scheduling.
Exposure to cloud data platforms (AWS / Azure / GCP).
Experience in Banking, Financial Services, or Insurance (BFSI) domain.
Knowledge of data lake architecture and governance frameworks.

4. Key Success Metrics (KPIs)
SLA adherence and production stability
Team productivity and quality standards

The candidate should have minimum 7.5 years of experience in Cloudera Data Platform.

This position is based at our Chennai office.

A 15 years full time education is required.

Qualification 15 years full time education