Data Engineer

Data Engineer – Identity Resolution & Consent Data

Location: Bangalore / Hyderabad
Experience: 5–7 Years
Department: Data & Analytics
Role Focus: Data Engineering | Identity Resolution | Consent & Privacy Data

Key Responsibilities

• Design and manage Identity/Entity Resolution pipelines to unify customer/contact records from multiple systems.
• Build matching, scoring, clustering, deduplication and golden-record/Customer 360 logic.
• Develop and maintain scalable data pipelines using SQL, Snowflake, dbt and Python.
• Integrate consent and preference data from OneTrust or similar Consent Management Platforms (CMP).
• Connect consent signals with the correct customer identity across CRM and Marketing platforms.
• Build data models supporting privacy regulations such as GDPR, CCPA/CPRA and CASL.
• Define data-quality rules, source-system onboarding standards and field-mastering/survivorship logic.
• Develop incremental dbt models and optimize pipelines as data volumes and source systems increase.
• Automate data-quality checks, match validation and categorization using Python and AI/LLM tools.
• Build testing, monitoring and validation mechanisms to maintain reliable and auditable data pipelines.
• Work closely with Privacy, Legal and Marketing teams on consent and identity-data requirements.

Must-Have Skills

• 5–7 years of Data Engineering / Privacy Engineering / Identity Resolution experience.
• Strong hands-on SQL.
• Experience with Snowflake or a similar cloud data warehouse.
• Hands-on dbt, including incremental models/materialization.
• Strong Python for data pipelines, automation and testing.
• Experience/understanding of Identity Resolution / Entity Resolution, including matching, scoring and clustering.
• Experience with OneTrust or another Consent Management Platform.
• Understanding of GDPR, CCPA/CPRA, CASL and consent/privacy data.
• Experience integrating data across CRM, Marketing Automation and other enterprise systems.
• Exposure to AI tools/LLMs for data quality, categorization or automation.

Good-to-Have

• Salesforce / Eloqua
• Airflow
• AWS
• MDM / Customer 360 / Golden Record experience
• JavaScript stored procedures
• Experience working in a complex B2B enterprise data environmen