Azure senior Data Engineer

Desired Competencies (Technical/Behavioral Competency)

Must-Have

• Develop and implement Data pipelines and algorithms using Databricks, ADF, Python programming language, jointly with knowledge about Pandas, NumPy, Pyspark, SQL and similar libraries.
• Should have working knowledge in devops and should be well versed in Databricks to solve real-world problems.
• Should have working knowledge in Azure cloud data lake storage and azure services.
• Utilize SQL for data Extraction, Transformation, and Loading (ETL) processes.

Good-to-Have

• Work well within a team environment.
• Familiar with Agile development methodology
• Experience with JIRA, ADLM Tools
• Ability to prioritize, status, and multitask.

Role descriptions / Expectations from the Role 

Work closely with engineers, researchers, and data scientists to gather requirements, perform data analysis, and develop end-to-end pipelines.

Independently develop, code or modify, test, and debug application programs of varying degree of complexity

Conduct experiments and perform data analysis to ensure the robustness, scalability, and accuracy of provided solutions

Optimize and fine-tune for performance and efficiency.

Details of the Role (For Candidate Briefing)

Reporting To Which Role - Tech Manager

Size of the Team, if any Reporting to this Role - 16

On-site Opportunity -NA

Unique Selling Proposition (USP) of The Role -Opportunity to work on cutting-edge projects at the forefront of technology. Collaborative and innovative work environment.

Details of The Project (A short Briefing on the Project can be provided herewith. It may be shared with external stakeholders like job agencies etc. - The client is one of the leading information, data and market measurement firms operating in over 100 countries. It helps packaged goods companies and retailers understand what consumers are buying in terms of categories, brands, and products.