ARCHITECT - Databricks

Location: SMILES 1, Bengaluru, Bengaluru

Years of Experience: 10-13 Years

Job Summary: We are seeking a highly skilled Databricks Architect with extensive experience in designing and implementing data solutions using Databricks. The ideal candidate will have a strong background in data engineering, cloud technologies, and big data analytics. This role requires a strategic thinker who can lead projects from conception to execution while collaborating with cross-functional teams to deliver high-quality data solutions.

Responsibilities:

• Design and implement scalable data architectures using Databricks.
• Collaborate with data scientists, data engineers, and business stakeholders to understand data requirements and translate them into technical specifications.
• Develop and maintain ETL processes to ensure data quality and integrity.
• Optimize data pipelines for performance and cost efficiency.
• Provide technical leadership and mentorship to junior team members.
• Stay updated with the latest Databricks features and best practices to continuously improve data solutions.
• Conduct code reviews and ensure adherence to best practices in data engineering.
• Document architecture designs, data flows, and processes for future reference.

Mandatory Skills:

• Proven experience with Databricks and its ecosystem.
• Strong knowledge of Apache Spark and big data technologies.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Proficiency in programming languages such as Python, Scala, or Java.
• Solid understanding of data modeling, data warehousing, and ETL processes.
• Excellent problem-solving skills and ability to work under pressure.

Preferred Skills:

• Experience with machine learning frameworks and libraries.
• Familiarity with data visualization tools like Tableau or Power BI.
• Knowledge of DevOps practices and CI/CD pipelines.
• Experience in Agile methodologies and project management.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 10-13 years of experience in data architecture, data engineering, or related roles.
• Relevant certifications in Databricks or cloud platforms are a plus.

If you are a passionate Databricks Architect looking to make a significant impact in a dynamic environment, we encourage you to apply.