Azure Databricks Engineer

Desired Competencies

Must-Have

• Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between different system like ADLS, ADF, Synapse, Databricks etc.
• A minimum of 5 years' experience with large SQL data marts. Expert relational database experience, Candidate should demonstrate ability to navigate through massive volumes of data to deliver effective and efficient data extraction, design, load, and reporting solutions to business partners,
• Minimum 5 years of troubleshooting and Supporting large databases and testing activities; Identifying reporting, and managing database security issues, user access/management; Designing database backup, archiving and storage, performance tuning, ETL importing large volume of data extracted from multiple systems, capacity planning
• Experience in TSQL programming along with Azure Data Factory framework and Python scripting
• Work well independently as well as within a team
• Proactive, organized, excellent analytical and problem-solving skills
• Flexible and willing to learn, can-do attitude is key
• Strong verbal and written communication skills

Good-to-Have

• Financial institution data mart experience is an asset.
• Experience in .net application is an asset
• Experience and expertise in Tableau driven dashboard design is an asset

Required Technical Skill Set

Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL