SENIOR SOFTWARE ENGINEER - Azure Databricks
Happiest Minds Technologies · Bengaluru · onsite · Posted 33d ago
Undisclosed5–8 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
SaaS Databricks Engineer
Location: Bengaluru (Hybrid)
Experience: 5-8 Years
Employment Type: Full-Time
Job Summary: We are seeking a highly skilled SaaS Databricks Engineer to design, develop, and optimize cloud-native data engineering solutions on Azure Databricks. The ideal candidate will have strong expertise in PySpark, SQL, Delta Lake, Azure Data Factory, and modern data platform architectures. The role involves building scalable ETL/ELT pipelines, supporting SaaS applications, and ensuring reliable data delivery across enterprise environments.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.
- Build and optimize ETL/ELT workflows for large-scale data processing.
- Implement and manage Bronze, Silver, and Gold Lakehouse architectures using Delta Lake.
- Integrate SaaS applications and external data sources into enterprise data platforms.
- Develop data ingestion frameworks using Azure Data Factory (ADF).
- Optimize Databricks clusters, notebooks, and Spark workloads for performance and cost efficiency.
- Implement data quality, validation, audit, and reconciliation controls.
- Work with Azure Data Lake Storage Gen2 (ADLS), SQL databases, and cloud-native storage solutions.
- Automate deployment processes using CI/CD pipelines (Azure DevOps or GitHub Actions).
- Perform troubleshooting, root cause analysis, and production support activities.
- Ensure security, governance, and compliance using RBAC, Key Vault, and managed identities.
- Monitor pipeline health and implement proactive alerting and observability solutions.
- Collaborate with architects, analysts, business stakeholders, and product teams.
- Create technical documentation, data flow diagrams, and operational runbooks.
- Continuously recommend improvements in platform scalability, reliability, and cost optimization.
Mandatory Skills:
- 5-8 years of Data Engineering experience.
- 3+ years of hands-on Azure Databricks experience.
- Strong expertise in PySpark and Spark SQL.
- Experience with Azure Data Factory (ADF).
- Knowledge of Delta Lake and Lakehouse Architecture.
- Familiarity with Azure Data Lake Storage Gen2 (ADLS).
- Proficiency in SQL Server / Azure SQL.
- Python programming skills.
- Experience in ETL/ELT development and optimization.
- CI/CD experience using Azure DevOps or GitHub Actions.
- Understanding of Data Modelling and Data Warehousing concepts.
Preferred Skills:
- Databricks Certified Data Engineer Associate/Professional.
- Microsoft Azure Data Engineer Associate (DP-203).
- Azure Fundamentals (AZ-900).
Qualifications: Bachelors degree in Computer Science, Information Technology, or a related field is preferred. Strong analytical and problem-solving skills, along with excellent communication and collaboration abilities, are essential for success in this role.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityAuditingTroubleshootingTechnical DocumentationPythonSQLComputer ScienceInformation TechnologyanalyticalProduction Support
About Happiest Minds Technologies
Happiest Minds Technologies
IT Services & Consulting
6.5k+
employees
2011
15 years old
Bangalore / Bengaluru, Karnataka
India
About
A technology firm specializing in digital transformation services utilizing advanced technologies to enhance enterprise efficiency and customer experience.
Industries
IT Services & Consulting
Employee ratings
1,441 reviews
3.4/ 5
Culture
3.4
Career growth
2.8
Work-life
3.6
Employees rate it well for
Work Life Balance210Work Culture165Senior Management138Salary104Learning80
Find them on