Databricks Software Architect

We are looking for a highly skilled and experienced Databricks Software Architect to join our team at Luxoft India LLP. The ideal candidate will have a strong background in designing and implementing data pipelines using Databricks.

• Design and implement scalable and efficient data pipelines using Databricks.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain technical documentation for data pipelines and architectures.
• Troubleshoot and resolve issues related to data pipeline failures or performance bottlenecks.
• Ensure compliance with industry standards and best practices for data security and governance.
• Mentor junior team members to improve their skills and knowledge in Databricks.

• Strong understanding of Databricks architecture and its components such as Spark, Hive, and Streamsets.
• Experience with big data technologies like Hadoop, NoSQL databases, and cloud-based platforms.
• Excellent problem-solving skills and the ability to analyze complex issues and develop creative solutions.
• Strong communication and collaboration skills to work effectively with technical and non-technical stakeholders.
• Ability to design and implement data pipelines using various tools and technologies such as AWS Glue, Azure Data Factory, or Google Cloud Dataflow.
• Strong attention to detail and the ability to write high-quality code that meets industry standards.