Senior Databricks Engineer with Python

We are looking for a skilled Senior Databricks Engineer with expertise in Python to join our team at Luxoft India LLP. The ideal candidate will have experience working with large datasets and developing scalable data pipelines.

• Design, develop, and deploy scalable data pipelines using Databricks.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain complex SQL queries to extract insights from large datasets.
• Implement data quality checks and validation processes to ensure accuracy and integrity.
• Optimize database performance and troubleshoot issues as needed.
• Work closely with stakeholders to understand their needs and provide technical guidance.

• Strong proficiency in Python programming language.
• Experience working with big data technologies such as Hadoop or Spark.
• Knowledge of cloud-based databases and data platforms.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment.
• Strong understanding of data modeling and database design principles.