Data Engineer [T500-27485]

About CIBC: CIBC is a leading North American bank, with a history of more than 150 years of living our purpose - to help make your ambition a reality. Client relationships are at the centre of our strategy, and our growth is enabled by a highly engaged and connected global team. From digital banking to community impact, we’re proud to drive progress for our clients and our communities. Recognized for our culture, award-winning innovation and community investment, CIBC continues to evolve by putting people and progress at the centre of everything we do.

About CIBC India: CIBC India is a technology and operations hub in Hyderabad, where you’ll be part of our highly engaged and global team, and play a central role in supporting our growth. Whether you’re driving innovation in digital banking or streamlining client onboarding, you’ll be part of a culture recognized for excellence and investment in people. At CIBC India, people and progress are at the centre of what we do: you’ll develop skills, collaborate with industry leaders, and see your ideas realized in a culture that values progress and belonging. We provide cutting-edge resources, ongoing learning, and a supportive environment where people come first. If you’re ready to create meaningful change and build your future, CIBC India is where your ambition meets opportunity.

What CIBC India Offers: At CIBC India, your goals are a priority. We start with your strengths and ambitions and strive to create opportunities to tap into your potential. We aspire to give you a career that goes well beyond your compensation.

• We work to recognize you in meaningful, personalized ways including competitive fixed pay, performance-based incentive programs, a family-first benefits program, employer contributions for your retirement, attractive time off and leave offerings, wellbeing support, and MomentMakers, our social, points-based recognition program.
• Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients worldwide.
• We cultivate a culture where you can express your ambition through initiatives like Purpose Day, a paid day off dedicated for you to use to invest in your growth and development.

What You’ll Be Doing (position summary): The Data Engineer will join the Equities Market Technology organization at CIBC Capital Markets. In this role, you will deliver new Data & AI initiatives on Microsoft Azure, with a primary focus on Azure Databricks and Azure Data Factory (ADF), to ingest and land data from multiple internal and external sources, transform it, and build curated silver and gold data layers. You will apply appropriate data modeling techniques to prepare datasets for analytics and machine learning workloads, partnering closely with data scientists, analytics engineers, and business stakeholders to ensure the data reflects business meaning, quality, and usability.

How You’ll Succeed (responsibilities):

• Develop data pipelines using Azure Data Factory (ADF) for orchestration and Azure Databricks (Spark) for transformation to deliver reliable, well structured datasets.
• Develop Spark-based transformation notebooks/jobs (PySpark/SQL) using engineering best practices (readability, reusability, testing).
• Design and apply data models (e.g., dimensional, relational, lakehouse patterns) to make data discoverable and usable for analytics and ML workloads.
• Work directly with business stakeholders, analytics teams, and data scientists to translate domain requirements into clear ingestion, transformation, and data product specifications; validate outputs for analytical correctness.
• Ingest and land data into the bronze layer from multiple sources (files, APIs, databases), including scheduling, parameterization, and rerun support.
• Build transformation logic to produce curated silver and gold datasets, applying business rules and ensuring suitability for analytical reporting and feature engineering.
• Implement data quality checks and reconciliations to ensure accuracy, completeness, and consistency of curated datasets.
• Implement CI/CD, version control, and automated testing for pipelines and notebooks (e.g., Azure DevOps/Git), including logging and alerting for operational support.
• Partner with platform and security teams to apply data governance and security controls (e.g., access management, encryption, retention) in accordance with CIBC standards.

CROSS-FUNCTIONAL RELATIONSHIPS:

• Engages directly with business stakeholders to understand domain needs and priorities; works with business analysts where applicable to refine requirements and acceptance criteria.
• Collaborates with solution architects and engineering leads on design, patterns, and technology standards.
• Partners with platform and security teams to align on governance, access controls, and environment readiness for data delivery.
• Works with QA and engineering teams to support functional and regression testing and to ensure release quality.
• Coordinates with production support to ensure operational readiness and timely issue resolution.

COMPLIANCE REQUIREMENTS/RESPONSIBILITIES:

• As an employee of CIBC, the incumbent must comply with all applicable CIBC and Line of Business policies, standards, guidelines and controls.

AUTHORITIES/DECISION RIGHTS: Within assigned projects, the incumbent may recommend improvements to data processes and technical implementation approaches to enhance quality, reliability, and delivery outcomes, in alignment with established governance and approval processes.

JOB DIMENSIONS:

• Individual contributor role focused on development and delivery of technology solutions.
• Delivers data ingestion and transformation solutions that support Capital Markets analytics, reporting, and AI/ML use cases (e.g., trading, risk, operations, and post trade data).
• Provides technical expertise and advisory support to peers and business partners.

Experience: 6+ years of experience.

Who You Are (skills/qualifications): Must Have Skills:

• 6+ years of experience in data engineering (data integration, ETL/ELT, and/or data platform development) within enterprise or financial services environments.
• Hands on experience with Azure Databricks, Apache Spark (PySpark), Databricks SQL, and Delta Lake/lakehouse patterns.
• Strong orchestration and integration skills using Azure Data Factory (pipelines, triggers, linked services, parameterization) and common ingestion patterns (batch, incremental, CDC).
• Proficiency in SQL and Python to implement transformations and create curated datasets for analytics and AI/ML feature engineering.
• Working knowledge of Azure data services such as ADLS Gen2, Key Vault, Azure SQL/MI, and Event Hubs/Service Bus; experience with Azure DevOps/Git for CI/CD and secure access patterns; able to partner effectively with platform teams on environment readiness.
• Experience with Oracle databases (e.g., Oracle SQL/PL/SQL) for analyzing data and writing complex procedures and materialized views.
• Hands-on experience delivering ingestion and transformation projects that build bronze/silver/gold data layers and apply data modeling techniques for analytical reporting and ML/AI workloads.
• Experience supporting production data pipelines with operational support practices (monitoring, alerting, incident response, root cause analysis, and reliability improvements).
• Strong communication skills, ability to work independently, and effective collaboration with cross-functional teams.
• Strong analytical skills and domain understanding to translate business questions into data transformations suitable for analytics and ML workloads.
• Comfortable operating in a fast paced, delivery focused environment.

Good to Have:

• Exposure to Capital Markets domains such as Equities Trading, Prime Brokerage, Clearing, or Post Trade Processing is a strong asset

Privacy: By proceeding with the creation of a profile and submitting an application in response to this job posting, you acknowledge and agree that your personal data will be collected, used, retained and disclosed by CIBC India and its affiliates, as described in the Candidate Privacy Statement.