Azure Databricks Engineer

Dear Professionals

Greetings from Tata consultancy Services,

Job Title : Azure Databricks Engineer

Experiernce: 6 to 12 Years

Location: Pune

Mode of Work : Work from Office

Mode of Interview: Virtual

If you are Interested in the above opportunity kindly share your updated resume to [email removed] immediately with the details below (Mandatory)

Name:

Contact No.

Email id:

Skillset:

Total exp:

Relevant Exp:

Fulltime highest qualification (Year of completion with percentage scored):

Current organization details (Payroll company):

Current CTC:

Expected CTC:

Notice period:

Current location:

Preffered Location

Any gaps between your education or career (If yes pls specify the duration):

Will you be able to join within 30/45 days? (Yes/NO)

Key Responsibilities

Role : Azure Databricks Engineer

• Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines, data models and spark-based applications in Big Data environments.
• Extensive experience and deep expertise in data modeling and data model concepts, particularly with large datasets, ensuring the design and implementation of efficient, scalable, and high-performing data models.
• Strong software engineer, you take pride in what youre developing with a strong testing ethos.
• String proficiency in Python programming, with a focus on data processing and analysis
• Proven experience working with PySpark for large-scale data processing and analysis
• Extensive experience in designing, building, and optimizing Big Data pipelines and architectures, with a strong focus on supporting both batch and real-time data workflows.
• Hand-on Experience with cloud technologies and big data concepts, especially in Azure Databricks, Azure Data Lake and Azure Data Factory
• In-Depth Knowledge of Spark, including experience with Spark performance tuning techniques to optimal processing efficiency
• Strong SQL skills for querying and manipulating large datasets, with experience in optimizing complex queries for performance

• Experience in automating data workflows and implementing CI/CD pipelines for data applications, ensuring efficient deployment and monitoring
• Any experience / knowledge in PowerShell, bash, perl scripting is desirable.
• Any Knowledge in BI Reporting tool (eg. Power BI) is a plus
• Experience with Agile Methodology, Scrum Methodology is a plus
• Experience in the financial sector is a plus, but not essential

Experience with DevOps tools such as GitLab and CI/CD pipelines is a plus