Azure Data Engineer

Skills - ,ADB, Pyspark , ADF,DWH +Production Support + Client facing exp + Excellent Comms

Stack exp & Code Language

Responsibilities :

• Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies.
• The Tech Lead should be highly proficient in the use of Big Data / Open-Source Technologies and standard techniques of Data Integration, Data Manipulation.
• Should be able to design and develop cost efficient and performant data pipelines in the cloud platform
• Create data environment to support our data analytics, reporting and data science teams
• Experience with integration of data from multiple data sources
• Knowledge of various Data Pipeline techniques and frameworks
• Performance optimization - need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution.
• Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need