Data Engineer (Databricks & Fabric) - Remote

About the Role

We are seeking a highly skilled and experienced Data Engineer specializing in Databricks and Fabric to join our dynamic team. In this remote position, you will play a pivotal role in designing and implementing robust data pipelines and data solutions that drive business insights and decision-making. Your expertise will help us leverage Databricks and Fabric to enhance our data processing capabilities, ensuring scalability and performance. If you are passionate about data engineering and are looking to make a significant impact, we encourage you to apply!

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
• Implement data transformation processes that ensure data quality and integrity.
• Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
• Optimize data storage and processing performance for large datasets.
• Monitor and troubleshoot data pipeline performance issues, ensuring minimal downtime.
• Documentation of data engineering processes and best practices.
• Mentor junior data engineers and promote knowledge sharing within the team.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a focus on Databricks and Fabric.
• Strong proficiency in SQL, Python, and Spark.
• Experience with data modeling and ETL best practices.
• Familiarity with cloud data platforms (e.g., Azure, AWS).
• Ability to work independently and collaboratively in a remote team environment.

Preferred Qualifications

• Master's degree in a relevant field.
• Experience with real-time data processing frameworks.
• Knowledge of data governance and compliance standards.
• Familiarity with Machine Learning concepts and tools.

Technical Skills Required

• Databricks
• Microsoft Fabric
• Apache Spark
• SQL
• Python
• Data Warehousing
• ETL Processes