BENGALURU · FULLTIME
Azure Databricks & PySpark Principal Consultant
Infosys
Bengaluru · onsite · Posted 4d ago
Sourced from
Undisclosed12–16 yrsfulltimeBengaluru
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Summary
Responsibilities
Technical Requirements
Educational Requirement
Preferred Skills
Service Line
We are looking for an experienced Data Engineer with 12-16 years of overall IT experience and strong expertise in Azure Databricks and PySpark. The ideal candidate should have extensive experience in building scalable data pipelines, processing large datasets, and delivering enterprise-grade data solutions on the Azure platform.
Responsibilities
- Design, develop, and optimize large-scale data pipelines using Azure Databricks and PySpark.
- Build and maintain ETL/ELT workflows using Azure Data Factory.
- Develop scalable data processing frameworks for batch and near real-time data ingestion.
- Implement data transformation, cleansing, and enrichment processes.
- Work with large-scale structured and unstructured datasets in Azure Data Lake.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with business stakeholders, architects, and analytics teams to deliver data solutions.
- Ensure data quality, security, governance, and compliance standards are met.
- Provide production support, troubleshoot issues, and drive continuous improvements.
- Mentor junior team members and contribute to technical solution design.
Technical Requirements
- 12-16 years of IT experience with strong Data Engineering expertise.
- Hands-on experience in Azure Databricks and PySpark development.
- Strong knowledge of Azure Data Factory (ADF).
- Expertise in SQL and Data Warehousing concepts.
- Experience with Azure Data Lake Storage (ADLS Gen2).
- Strong understanding of Spark architecture and performance tuning.
- Experience designing and implementing enterprise-scale data pipelines.
- Knowledge of CI/CD and Agile delivery practices.
Educational Requirement
- MBA, MCA, ME, MSc, MTech, Bachelor of Engineering, BCA, BSc, BTech
Preferred Skills
- Databricks
- PySpark
- Azure
- Data Engineering
- Big Data - Data Processing
- Azure Networking Services
- Azure Bastion
Service Line
Data & Analytics Unit
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
AgileData EngineerData ingestioncloud platformAdls Gen2Agile DeliveryAzure NetworkingAnalyticsADLSData EngineeringcloudArchitectureAzure Data FactoryAzure DatabricksAzure Data LakecomplianceMicrosoft AzureBig Data
Section · Company
About Infosys
Infosys
IT Services & Consulting
323.6k+
employees
1981
45 years old
Bengaluru/Bangalore, Karnataka
India
About
Infosys is a global leader in next-generation digital services and consulting.
Industries
IT Services & ConsultingConsulting
Employee ratings
48,765 reviews
3.5/ 5
Culture
3.6
Career growth
2.6
Work-life
3.6
Employees rate it well for
Salary10252Work Life Balance6251Work Culture5404Learning4530Appraisal3780
Find them on