Databricks Data Engineer

Role & Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build ETL/ELT solutions for processing large-scale datasets.
• Develop and optimize data transformation workflows using PySpark and Spark SQL.
• Work with Delta Lake and modern data lake architectures.
• Integrate data from multiple source systems into enterprise platforms.
• Monitor, troubleshoot, and optimize data processing jobs.
• Collaborate with business and technical stakeholders to understand requirements.
• Ensure data quality, governance, security, and performance standards.
• Support deployment and maintenance of enterprise data solutions.

Preferred Candidate Profile

• 2-5 years of experience in Data Engineering or Big Data technologies.
• Strong hands-on experience with Databricks.
• Expertise in PySpark and Spark SQL.
• Experience in ETL/ELT development.
• Good understanding of Data Warehousing concepts.
• Strong SQL and database skills.
• Experience with Azure Data Factory or similar cloud data integration tools.
• Exposure to Delta Lake and data lake architecture.
• Strong analytical, problem-solving, and communication skills