Application Support Engineer - Databricks

HIRING FOR APPLICATION SOFTWARE ENGINEER - IMMEDIATE JOINER - ROTATIONAL SHIFTS

Key Responsibilities:

• Design, build, and maintain scalable data solutions using the Databricks platform.
• Develop and optimize batch and streaming data pipelines using Apache Spark, Python, and SQL.
• Implement modern data pipelines using Spark Declarative Pipelines (SDP), including streaming tables, materialized views, and embedded data quality rules.
• Apply ETL design patterns and best practices for robust and efficient data processing.
• Design and manage data models using medallion architecture, dimensional modeling, and Delta Lake optimization techniques.
• Create and maintain dashboards and visualizations using Databricks SQL, Lakeview dashboards, notebook charting libraries, and BI tools such as Power BI and Tableau.
• Manage Databricks workspaces, cluster configurations, notebooks, and Unity Catalog for secure and governed data access.
• Implement CI/CD pipelines, job orchestration using Lakeflow Jobs, and deployment automation with Asset Bundles.
• Ensure compliance with governance and security standards through Unity Catalog permissions, row/column-level security, and audit logging.
• Collaborate with cross-functional teams to deliver high-quality, scalable, and secure data solutions.

Required Skills & Qualifications:

• Strong knowledge of Databricks platform fundamentals, including workspaces, clusters, notebooks, and Unity Catalog.
• Proficiency in Python, SQL, and Apache Spark (batch and streaming).
• Hands-on experience with Delta Lake and modern ETL/data engineering design patterns.
• Experience with Spark Declarative Pipelines (SDP).
• Good understanding of data modeling techniques, including medallion architecture and dimensional modeling.
• Experience in developing dashboards and reports using Databricks SQL, Lakeview, Power BI, or Tableau.
• Familiarity with DevOps practices, including CI/CD and deployment automation.
• Knowledge of data governance and security concepts within Databricks.

Preferred Skills:

• Experience with MLflow, Terraform, and REST APIs.
• Exposure to cloud platforms such as AWS, Azure, or GCP.

If Interested, please share your updated resume on [email removed]