Data Engineer - Enterprise Data Lakehouse & Data Products
3M · Bengaluru · onsite · Posted 1d ago
Undisclosed5–10 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Collaborate with Innovative 3Mers Around the World
Choosing where to start and grow your career has a major impact on your professional and personal life, so it s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a wide variety of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.
The Impact You ll Make in this Role
As a Data Engineer, you will have the opportunity to tap into your curiosity and collaborate with some of the most innovative people around the world. Here, you will make an impact by:
- Leads the design and delivery of scalable data pipelines and data products on 3Ms AWS-based Enterprise Data Lakehouse. These use Databricks, PySpark, Python and SQL, and follow the Bronze Silver Gold Medallion architecture.
- Implements data quality, validation, reconciliation and monitoring controls, along with RBAC and data masking. These include SOX-compliant controls for close-critical financial data.
- Determines data needs by partnering with analysts, product owners and architects across Finance, Supply Chain, R&D, Tax and Commercial. Then turns them into reusable, analytics-ready datasets through the POC Pilot Prod pathway.
- Supports the platform and consumption layers. That covers AWS services (S3, Glue, Step Functions, Lambda, Athena), Apache Iceberg, Databricks, Snowflake objects, CI/CD, and Power BI and semantic models.
Your Skills and Expertise
To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:
- Bachelors degree or higher in Computer Science, Information Technology, Engineering or a related discipline (completed and verified prior to start).
- 5+ years of experience in data engineering or analytics engineering in a private, public, government or military environment.
- Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation.
- Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services (S3, Glue, Lambda, Athena or equivalent).
- Experience developing and supporting production data pipelines using Git and CI/CD practices, with an understanding of data modeling, data quality, validation and monitoring.
Additional qualifications that could help you succeed even further in this role include:
- Experience with data build tool for SQL-based transformation and testing, Snowflake as a SQL consumption layer, and Apache Iceberg or Delta Lake.
- Experience with Databricks Unity Catalog and orchestration tools (Step Functions, Airflow), and knowledge of data contracts, observability, SOX-compliant controls and catalog tools (Collibra, Alation, Glue Data Catalog).
- Relevant Databricks, AWS, Snowflake or data build tool certifications.
- Skills include clear communication, analytical problem-solving, and collaborating with business stakeholders in Agile, data-product-oriented teams.
Bangalore (Hebbal), Hybrid Mode
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityData MaskingAgileData EngineerData LakehouseApacheAws Servicesamazon web servicesapache airflow3mAnalyticsData Build ToolAlationData EngineeringArchitectureData CatalogcomplianceData ProcessingData ModelingData Pipeline
About 3M
3M
Electronics Manufacturing
1.1k+
employees
1987
39 years old
Bangalore / Bengaluru, Karnataka
India
₹18.6L PA avg
Avg at 3M
About
3M is a multinational conglomerate dedicated to innovation, producing a wide range of market-leading products across numerous industries.
Industries
Electronics ManufacturingConsumer goodsElectronics
Employee ratings
10 reviews
4.0/ 5
Culture
3.8
Career growth
2.9
Work-life
3.8
Employees rate it well for
Company Culture40Work-Life Balance40
Find them on