PUNE · FULLTIME
Azure Databricks Developer
BirlaSoft
Pune · onsite · Posted 48d ago
Sourced from
Undisclosed3–11 yrsfulltimePune
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.8s
- Found the form on Naukri · 5 questions to answer1.6s
- Decided the answers for all of them3.2s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Area(s) of responsibility
Key Responsibilities 1. Data Engineering Execution
- Build and maintain ingestion frameworks (ADF / Databricks / Spark)
- Implement Bronze -> Silver transformations aligned to architecture
- Architect data quality checks, schema validation, and contract rules
- Build and optimize robust, high-throughput ELT/ETL pipelines, enabling ingestion, transformation, and curation of structured, semi structured, and unstructured data.
- Integrate data from multiple on premise and cloud based systems, APIs, and third-party sources.
- Implement complex transformations using PySpark, ensuring performance efficiency and code modularity.
- Build orchestration workflows in ADF, including pipelines, triggers, linked services, integration runtimes, and parameterized datasets.
- Familiar with using Databricks Genie.
- Build: Dimensional models (star/snowflake schemas), Fact tables, dimensions, surrogate keys, SCD handling
- Translate Silver datasets into: Analytics-ready models, Consistent KPI definitions and business logic
- Ensure: Consistency across domains (common dimensions, conformed models), Reusability and scalability of models
- Develop scalable transformation scripts using PySpark on Databricks, applying advanced optimizations like caching, partitioning, and Delta Lake capabilities.
- Implement Delta Lake features-ACID transactions, schema enforcement, schema evolution, and time travel-across the data lifecycle.
- Perform performance tuning, handling bottlenecks related to cluster configuration, shuffle operations, joins, and parallelization.
- Collaborate with platform teams to manage Databricks clusters, jobs, notebooks, and CI/CD integrations.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Section · 02
Skills
data qualityschemaPerformance TuningDeltaorchestrationscalabilityFactAnalyticsmanagementKPI
Section · Company
About Birlasoft
BirlaSoft
IT Services & Consulting
10.9k+
employees
1995
31 years old
Pune, Maharashtra
India
About
Birlasoft combines the power of a domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!
Industries
IT Services & Consulting
Employee ratings
3,764 reviews
3.4/ 5
Culture
3.3
Career growth
2.6
Work-life
3.6
Employees rate it well for
Work Life Balance532Salary397Senior Management376Work Culture319Appraisal309
Find them on