Data Engineer

Job Summary

As a Data Architect you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure Synapse Analytics and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations. Experience in Databricks and Spark on other cloud platforms like AWS and GCP is also relevant.

Responsibilities

• Defines, designs, develops and tests software components/applications using Microsoft Azure (Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Logic Apps, Azure SQL Database, Azure Key Vaults, ADLS).
• Strong SQL skills with experience.
• Experience handling structured and unstructured datasets.
• Experience in Data Modeling and advanced SQL techniques.
• Experience implementing Azure Data Factory, Airflow, AWS Glue or other data orchestration tools using latest technologies and techniques.
• Good exposure in Application Development.
• The candidate should work independently with minimal supervision.

Qualifications

• B.Tech/BCA or any Graduation
• Hands on experience with distributed computing framework like DataBricks, Spark- Ecosystem (Spark Core, PySpark, Spark Streaming, SparkSQL)
• Willing to work with product teams to best optimize product features/functions.
• Experience on Batch workloads and real time streaming with high volume data frequency
• Performance optimization on Spark workloads
• Environment setup, user management, Authentication and cluster management on Databricks
• Professional curiosity and the ability to enable yourself in new technologies and tasks.
• Good understanding of SQL and a good grasp of relational and analytical database management theory and practice.

Skills

• Azure Databricks
• Azure Data Factory
• Azure Data Lake Storage

Work Mode

Work from Office

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.