Databricks Developer

Description

- Should be able to work with architect and lead engineers for solutions to meet functional and non-functional requirements.
- Demonstrated knowledge of relevant industry trends and standards.
- Demonstrate strong analytical and technical problem-solving skills.
- Must have excellent coding skills in Python.
- Must have implemented at least 1 project end-to-end in Databricks.
- Must have at least experience on databricks which consists of various components as below
o Delta lake
o Unity catalog
o Basic governance knowledge
o Databricks workflows orchestration
- Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
- Must have good understanding to create complex data pipelines
- Must have good knowledge of Data structure & algorithms.
- Must be strong in SQL and spark-sql.
- Must have strong performance optimization skills to improve efficiency and reduce cost.
- Must have worked on both Batch and streaming data pipeline.
- Must have extensive knowledge of Spark and Hive data processing framework.
- Must have strong communication skills and should be able to work directly with customer.
- Must have great attitude towards learning new skills and upskilling the existing skills.