Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load (ETL) data from various sources into Azure storage solutions.
• Collaborate with cross-functional teams to understand business requirements and design ETL processes that meet those needs.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Oracle databases.
• Implement data quality checks and validation rules to ensure high-quality data processing.

Job Requirements :

• 4-8 years of experience in a similar role as an ADF Engineer or related field such as ETL development or database administration.
• Strong understanding of Azure services including Azure Storage, Cosmos DB, Data Bricks etc. .
• Proficiency in Python programming language with experience working with PySpark for big data processing tasks.
• Experience with Oracle ADf (Oracle Application Development Framework) for building scalable applications.