Databricks Engineer

Data Engineer Python, PySpark & Databricks

Company: NICE Software Solutions
Experience: 5 - 8 years
Location: Chennai / Bengaluru
Work Mode: Hybrid
Notice Period: Immediate joiners or candidates who can join within 30 days preferred

About NICE Software Solutions

NICE Software Solutions is a business intelligence solutions company focused on delivering impactful, self-driven BI applications that support business growth.

Role Overview

We are looking for a hands-on Data Engineer with 58 years of experience and strong expertise in Python, PySpark, SQL, and Databricks. The ideal candidate will have experience building scalable data pipelines, implementing ETL workflows, and developing data warehouse solutions.

The role also requires familiarity with Apache Airflow, Linux administration, shell scripting, and practical experience using AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor.

Key Responsibilities

Data Pipeline Development

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
• Ingest, process, and transform data from multiple sources.
• Implement data quality checks and monitoring to ensure pipeline reliability and data integrity.

Databricks Development & Optimization

• Use Databricks for data ingestion, ETL processing, transformation, and analysis.
• Develop and optimize Databricks jobs and clusters for performance and cost efficiency.
• Work with large volumes of structured and unstructured data.

Data Warehousing & Modelling

• Build and optimize data warehouse solutions for efficient data storage and retrieval.
• Design and implement data models to support analytical and reporting requirements.
• Apply best practices across ETL development and data warehousing processes.

Workflow Orchestration

• Develop, configure, and manage Apache Airflow DAGs for pipeline orchestration and scheduling.
• Implement error handling, monitoring, and alerting to support reliable workflow execution.

Linux & Shell Scripting

• Work with Linux-based environments supporting data engineering workloads.
• Troubleshoot infrastructure and server-related issues.
• Develop shell scripts to automate routine data engineering tasks.

AI-Assisted Development

• Use AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor in day-to-day engineering work.
• Leverage these tools to improve development productivity, code quality, and efficiency.

Collaboration & Documentation

• Collaborate with Data Scientists, Data Analysts, and business stakeholders to understand requirements and deliver effective data solutions.
• Document data pipelines, workflows, technical solutions, and best practices.
• Contribute to the continuous improvement of data engineering practices and standards.

Required Skills & Qualifications

• 58 years of experience in Data Engineering or a similar role.
• Strong hands-on experience with Python, PySpark, SQL, and Databricks.
• Strong understanding of data modelling, ETL processes, and data warehousing concepts.
• Familiarity with Apache Airflow for workflow orchestration and scheduling.
• Experience with Linux administration and shell scripting.
• Practical experience using AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor.
• Strong problem-solving, analytical, communication, and collaboration skills.
• Bachelors degree in Computer Science, Engineering, or a related field.

Joining Preference

Candidates who can join immediately or within 30 days will be preferred.