DATA Engineering

Roles and Responsibilities :

• Design, develop, test, deploy and maintain ETL pipelines using Python to extract data from various sources and load it into the target database.
• Collaborate with cross-functional teams to understand business requirements and design scalable data warehousing solutions on cloud platforms such as AWS or Microsoft Azure.
• Develop complex SQL queries to optimize query performance, troubleshoot issues, and improve overall system efficiency.
• Ensure high availability of ETL processes by implementing monitoring tools, logging mechanisms, and alert systems.

Job Requirements :

• 4-6 years of experience in Data Engineering with expertise in ETL Pipelines development using Python.
• Strong understanding of Data Warehousing Concepts including dimensional modeling, star schema designs etc.
• Proficiency in Cloud Technologies such as AWS or Microsoft Azure for deploying applications.
• Prior experience in managing client stakeholders and junior team members.
  
• Proficient in big data processing and cloud technologies like AWS, Azure, Databricks, PySpark, Hadoop, etc. Proficiency in Informatica is a plus. Extensive hands-on experience in working with cloud data warehouses like Redshift, Azure Data Factory, Snowflake, etc. And Proficiency in SQL, Data Modeling, and designing ETLpipelines is a must.