Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Data Engineering

Good to have skills : NA
Minimum 15 year(s) of experience is required

Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role requires creating efficient data pipelines and ensuring the seamless migration and deployment of data across various systems. The position demands continuous monitoring and enhancement of data workflows to maintain high standards of data quality and reliability, enabling smooth data operations within the organization.

Roles Responsibilities:

Expected to be a SME with deep knowledge and experience.

Should have Influencing and Advisory skills.

Responsible for team decisions.

Engage with multiple teams and contribute on key decisions.

Expected to provide solutions to problems that apply across multiple teams.

Collaborate with stakeholders to align data engineering strategies with organizational goals.

Mentor and guide junior team members to foster professional growth and knowledge sharing.

Design and own governance on Databricks Unity Catalog catalog and schema architecture, external locations, volumes, lineage, audit logs, and row/column-level security.

Integrate PlainID / PBAC (Policy-Based Access Control) with the data tier to enforce identity-context attributes, Zero Trust, and least-privilege principles.

Define and run the GLR (Global Logical Resource) process for data asset registration, classification, and entitlement provisioning.

Lead enterprise data classification (PII, PHI, MNPI, GxP) using automated scanners and align controls with GDPR, India DPDP Act, HIPAA, and SOX.

Govern ACLs, service principals, secret scopes, and cluster policies across Databricks workspaces partner with Security, Risk, and Platform teams on operating-model rollout.

Advise senior stakeholders on data governance strategy, KPIs, and stewardship models mentor and lead a small governance pod.


Professional Technical Skills:

Must To Have Skills:

Proficiency in Data Engineering.

Strong expertise in designing and implementing scalable data pipelines and ETL processes.

Experience with data storage solutions and database management systems.

Ability to optimize data workflows for performance and reliability.

Familiarity with cloud-based data platforms and distributed computing frameworks.

Must-have skills: Unity Catalog governance design, PlainID / PBAC / ABAC integration, GLR process management, data classification, metadata management, regulatory compliance (GDPR, DPDP, HIPAA, SOX).- The candidate should have minimum 15 years of experience in Data Engineering.

This position is based at our Bengaluru office.

A 15 years full time education is required.

Must-have skills: Unity Catalog governance design, PlainID / PBAC / ABAC integration, GLR process management, data classification, metadata management, regulatory compliance (GDPR, DPDP, HIPAA, SOX).



Qualification 15 years full time education