Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Microsoft Azure Databricks

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and provide innovative solutions to enhance data accessibility and usability. Roles & Responsibilities:

• The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams, but also in the wider Business stakeholder community.
• A Senior Data engineer is expected to be a subject matter expert, who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver. Key Characteristics
• Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions.
• Deep data focus with expertise in technology domain
• A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
• Actively delivers the roll-out and embedding of Data Foundation initiatives in support of the key business programmers.
• Coordinate the change management process, incident management and problem management process.
• Present reports and findings to key stakeholders and be the subject matter expert on Data Analysis & Design.
• Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost, increase speed of implementation and maximize value delivery.
• Contributes to community building initiatives like CoE, CoP. Mandatory skills: AWS/Azure/SAP - Master ELT - Master Data Modeling - Master Data Integration & Ingestion - Skill Data Manipulation and Processing - Skill GITHUB, Action, Azure DevOps - Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift Professional & Technical Skills:
• Must To Have Skills: Proficiency in Microsoft Azure Databricks.
• Good To Have Skills: Experience with data warehousing solutions.
• Strong understanding of data modeling concepts and best practices.
• Familiarity with data governance and compliance standards.
• Experience in programming languages such as Python or Scala for data processing. Additional Information:
• The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.
• This position is based at our Bengaluru office.
• A 15 years full time education is required.