Data Engineer-Microsoft Azure Databricks

Job Description

• As a Data Engineer, you will design, develop, and maintain data solutions for data generation, collection, and processing. You will create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems. Your day will involve working on various data projects and collaborating with cross-functional teams to drive data initiatives.

Roles & Responsibilities:

• Serve as a Subject Matter Expert (SME) and manage the team to deliver results.
• Take responsibility for team-level decisions and performance.
• Collaborate with multiple teams and contribute to strategic technical decisions.
• Provide scalable and effective solutions for both team-specific and cross-team challenges.
• Lead the design and development of data solutions and infrastructure.
• Implement and optimize data pipelines for efficient and scalable data processing.
• Ensure data quality, consistency, and integrity throughout the data lifecycle.
• Partner with stakeholders to gather requirements and deliver data-driven solutions.

Professional & Technical Skills:

Must-Have Skills:

• Proficiency in Microsoft Azure Databricks
• Strong understanding of cloud-based data engineering concepts
• Experience with big data technologies such as Hadoop and Spark
• Solid knowledge of data modeling and database design principles
• Hands-on experience with SQL and NoSQL databases.

Experience Required:

• Minimum of 5 years of experience working with Microsoft Azure Data bricks

Educational Qualifications:

• 15 years of full-time education
• Bachelors or Masters degree in Computer Science, Engineering, Data Science, or a related field

Additional Information:

• This role is based in our Mumbai office
• Candidates should be comfortable working in a collaborative, fast-paced environment