REMOTEFULLTIME
Databricks + Azure Developer
TESTQ Technologies
Remote · remote · Posted 21d ago
Sourced from
Undisclosed9–10 yrsfulltimeRemote
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.6s
- Found the form on Naukri · 13 questions to answer1.0s
- Decided the answers for all of them2.9s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Role: Databricks + Azure Developer
Location: India
Mode: 100% remote
Time Shift: EST Time shift
Pref: Immediate Joiner
We are looking for an experienced Databricks + Azure Developer to design, build, and optimize scalable data engineering solutions on Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, ADLS Gen2, and modern data-pipeline development. The role involves building high-performance ETL/ELT pipelines, implementing Lakehouse architecture, and ensuring reliable, secure, and scalable data operations.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks and PySpark.
- Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF).
- Develop ingestion and transformation pipelines for structured and semi-structured data using ADLS Gen2, Delta Lake, and Spark SQL.
- Implement Medallion architecture (Bronze/Silver/Gold layers) and incremental loads, CDC, MERGE, and SCD Type 1/2.
- Optimize Spark jobs through partitioning, caching, file-size optimization, and performance-tuning techniques.
- Configure and maintain Databricks Workflows/Jobs, clusters, and workspace environments.
- Implement data quality checks, validation, error handling, monitoring, and reconciliation processes.
- Work with Unity Catalog for governance, lineage, RBAC, and secure data access.
- Integrate Databricks with Azure services (ADLS, Azure SQL, APIs, JDBC connections).
- Implement CI/CD pipelines using Azure DevOps and Git; automate infrastructure using Terraform or ARM/Bicep.
- Troubleshoot production pipelines, perform root-cause analysis, and ensure SLA compliance.
- Collaborate with architects, analysts, BI teams, and business stakeholders in an Agile environment.
Required Qualifications
- 9-10+ years of experience in Data Engineering or Azure cloud data development.
- Strong hands-on experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake.
- Experience building scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Strong understanding of ADLS Gen2, Lakehouse architecture, and distributed data processing.
- Experience with CI/CD (Azure DevOps), Git, YAML pipelines, and Infrastructure-as-Code (Terraform/ARM/Bicep).
- Solid SQL skills and experience with performance tuning.
- Experience working in Agile/Scrum environments.
Preferred Qualifications
- Experience with Databricks platform administration (clusters, jobs, workspace configuration).
- Knowledge of Unity Catalog, data governance, lineage, and RBAC.
- Experience integrating Databricks with APIs, JDBC sources, and external systems.
- Familiarity with monitoring tools (Datadog, Grafana) and cost optimization.
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Section · 02
Skills
CdcAzure DevopsAgileCI/CD PipelinesapisAzure ServicescachingAdls Gen2Azure SQLADLSData EngineeringcloudArchitectureAzure Data FactoryAzure DatabricksData GovernanceAdministrationcomplianceMicrosoft Azurebicep
Section · Company
About TESTQ Technologies
TESTQ Technologies
Software Product
11
employees
Pune, Maharashtra
India
₹4.3L PA avg
Avg at TESTQ Technologies
About
TESTQ TECHNOLOGIES LIMITED is a global IT services and solutions company headquartered in the UK. Our offerings span various industry sectors with strong technical, domain and process expertise helping clients grow their businesses and decrease operational costs continuously
Industries
Software Product
Employee ratings
10 reviews
3.3/ 5
Culture
3.3
Career growth
3.2
Work-life
3.6
Employees rate it well for
Job Security37Work-Life Balance35
Find them on