BENGALURU · FULLTIME
Data Engineer
IBM
Bengaluru · onsite · Posted 65d ago
Sourced from
Undisclosed4–7 yrsfulltimeBengaluru
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.8s
- Found the form on Naukri · 5 questions to answer1.0s
- Decided the answers for all of them2.7s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Your Role and Responsibilities:
Required Education:
Preferred education
Required Technical and Professional Expertise:
Preferred Technical and Professional Experience:
About the Role
As a Data Engineer II on the Data team, you will own meaningful slices of our data platform end-to-end from ingestion through transformation to the data products that power decision-making across the company. You'll design and operate batch and real-time pipelines, partner closely with Data Scientists, Analysts, and business stakeholders, and raise the bar on craftsmanship, reliability, and developer productivity for the team.
You'll work in a modern, AI-augmented engineering environment: shipping faster with Claude Code and other AI coding assistants, building AI-powered internal tools (natural-language-to-SQL, automated data quality, lineage, anomaly detection), and bringing GenAI thoughtfully into data workflows. We expect you to take significant projects from ambiguous problem statement to delivered outcome, mentor newer engineers, and represent the team confidently with cross-functional partners.
What You Will Do
- Design, build, and operate efficient, reliable, and well-documented data pipelines across batch and streaming systems from source ingestion through the warehouse to consumer-facing data products.
- Own the data models, SLAs, and quality contracts for the domains you cover; treat documentation, testing, and observability as first-class deliverables.
- Improve the data platform itself: introduce or extend tooling, templates, CI/CD, testing frameworks, and monitoring that make the entire team faster and more reliable.
- Adopt and champion AI-assisted engineering use Claude Code and similar tools as part of your daily workflow, build internal AI-powered utilities (text-to-SQL on the semantic layer, automated PR review, log triage, data discovery), and evaluate where LLMs add durable value vs. hype.
- Partner directly with Data Scientists, Analysts, and business stakeholders to translate ambiguous requirements into well-scoped deliverables; communicate trade-offs, anticipate push-back, and drive alignment without needing escalation.
- Mentor interns, new hires, and L2 engineers through onboarding, code review, design feedback, and pairing.
- Contribute to cloud infrastructure and governance: IAM, service accounts, secrets management, cost optimization, and Terraform-managed GCP / Confluent Cloud resources.
- Drive incident response and root-cause analysis for the pipelines you own; close the loop with durable fixes, runbooks, and prevention.
Required Education:
Bachelor's Degree
Preferred education
Master's Degree
Required Technical and Professional Expertise:
- 4 to 7 years of experience in Data Engineering at a technology company, including production ownership of non-trivial pipelines and data models.
- Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience.
- Strong command of advanced SQL and Python you can write production-grade code, review others' code, and pick the right tool for the job.
- - Solid grounding in dimensional modeling, data warehousing, and ELT/ETL fundamentals; you can design a clean star schema and explain the trade-offs.
- - Hands-on experience operating orchestration frameworks in production (Airflow / Cloud Composer, Dagster, or similar).
- - Hands-on experience building streaming and event-driven pipelines Kafka, Flink, or equivalent and reasoning about exactly-once, schema evolution, and back-pressure.
- - Experience on a major cloud platform (GCP preferred) and with infrastructure-as-code (Terraform).
- - Demonstrated ability to operate with moderate ambiguity: scope your own work, identify what to clarify, recommend an approach, get buy-in, and ship.
- - Fluency with AI coding assistants (Claude Code, Cursor, Copilot) as a daily tool and judgment about where they help vs. where they hurt.
- - Clear written and verbal communication; comfortable presenting designs, post-mortems, and trade-offs to technical and non-technical audiences.
Preferred Technical and Professional Experience:
- Production experience with dbt (or SQLMesh) and the surrounding ecosystem testing, packages, semantic layers (dbt Semantic Layer, Cube, Hex).
- Experience with open table formats (Apache Iceberg, Delta Lake) and modern lakehouse patterns.
- Familiarity with data quality / observability tooling (Great Expectations, Soda, Elementary, Monte Carlo) and catalog / lineage systems (DataHub, Atlan, Unity Catalog).
Sourced from naukri
Section · 02
Skills
Apache SparkScalaHiveamazon web servicessqoopApache HadoopData AnalyticsPysparkData EngineeringPythonTableauSQLData Warehousingdata analysisETLMicrosoft AzureBusiness IntelligenceSQL ServerBig DataData ScienceMachine Learning
Section · Company
About IBM

IBM
IT Services & Consulting
130k+
employees
1911
115 years old
Bangalore / Bengaluru, Karnataka
India
About
IBM has been dedicated to every client's success and to creating innovations that matter for the world.
Industries
IT Services & ConsultingFinancial ServicesEmerging Technologies
Employee ratings
25,767 reviews
3.9/ 5
Culture
3.9
Career growth
3.0
Work-life
4.0
Employees rate it well for
Work Life Balance4166Salary3460Work Culture2867Learning2246Senior Management1890
Find them on