Data Engineer

Dreaming big is in our DNA. It's who we are as a company. It's our culture. It's our heritage. And more than ever, it's our future. A future where we're always looking forward. Always serving up new ways to meet life's moments. A future where we keep dreaming bigger. We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash their full potential. The power we create together – when we combine your strengths with ours – is unstoppable. Are you ready to join a team that dreams as big as you do

Do You Dream Big

We Need You.

Job Description

Job Title: Azure Data Engineer

Location: Bangalore - India

Reporting to: Senior Azure Data Engineer

PURPOSE OF ROLE

We are seeking a skilled and motivated Azure Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience with Microsoft Azure cloud services, data engineering, and a background in designing and implementing scalable data solutions.

KEY TASKS AND ACCOUNTABILITIES

• Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory, Azure Databricks, and other relevant tools.
• Implement and optimize data storage solutions in Azure.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and implement solutions that align with business objectives.
• Ensure data quality, integrity, and security in all data-related processes and implementations.
• Work with both structured and unstructured data and implement data transformation and cleansing processes.
• Optimize and fine-tune performance of data solutions to meet both real-time and batch processing requirements.
• Troubleshoot and resolve issues related to data pipelines, ensuring minimal downtime and optimal performance.
• Stay current with industry trends and best practices, and proactively recommend improvements to existing data infrastructure.
• Data analysis, validation, and rectification of master data inconsistencies.

QUALIFICATIONS, EXPERIENCE, SKILLS

Education:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

Experience:

• Proven experience (3-5 Years) as a Data Engineer with a focus on Microsoft Azure technologies.
• Hands-on experience with Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics.
• Strong proficiency in SQL and experience with data modeling and ETL processes.
• Familiarity with data integration and orchestration tools.
• Knowledge of data warehousing concepts and best practices.
• Experience with version control systems, preferably Git.
• Excellent problem-solving and communication skills.

Technical/Functional Skills: Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics, airflow, python, PySpark, problem solving, critical thinking, research, data analysis

Mandatory Skills:

• Azure Services
• Pyspark
• SQL
• Data Analysis
• Problem Solving/Critical Thinking
• Git