Azure Databricks Consultant
Infosys · Bengaluru · onsite · Posted 37d ago
Undisclosed6–8 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Educational RequirementsBachelor of Engineering,BTech,BCA,BSc,ME,MTech,MCA,MSc,MBAService LineData Analytics UnitResponsibilities
- Design, develop, and maintain scalable Azure Databricks solutions for enterprise data platforms. Build and optimize end-to-end ETL/ELT pipelines using PySpark, Spark SQL, and Azure Data Factory (ADF). Develop robust data ingestion frameworks from multiple structured and unstructured data sources. Implement and manage Delta Lake and Lakehouse Architecture for high-volume data processing. Create and optimize data models, transformations, and workflows to support analytical and business requirements. Perform performance tuning and troubleshooting of Databricks workloads and Apache Spark jobs. Work with Azure services including ADLS Gen2, Azure Synapse Analytics, Azure Key Vault, and Azure Data Factory. Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions. Ensure adherence to data governance, security, and best practices. Participate in code reviews, CI/CD implementation, testing, deployment, and production support activities.
- 6 to 8 years of experience in Data Engineering and Big Data technologies.
- Strong hands-on experience with Azure Databricks and PySpark.
- Expertise in Apache Spark, Spark SQL, and distributed data processing.
- Experience with Azure Data Factory (ADF) and building enterprise-scale data pipelines.
- Strong knowledge of Azure Data Lake Storage (ADLS Gen2).
- Technology->Cloud Platform->Azure Core services->Azure Virtual Machines
- Technology->Cloud Integration->Azure Data Factory (ADF)
- Technology->Cloud Platform->Azure Networking Services->Azure Application Gateway
- Technology->Data Engineering->Databricks
Sourced from naukri
Skills
Apache Sparkcorecdbig data technologiesamazon web servicesAzure NetworkingPysparkData EngineeringPythoncloudSQLAzure Data FactoryAzure DatabricksAzure Data LakeData ProcessingMicrosoft AzureBig DataCi/Cd
About Infosys
Infosys
IT Services & Consulting
323.6k+
employees
1981
45 years old
Bengaluru/Bangalore, Karnataka
India
About
Infosys is a global leader in next-generation digital services and consulting.
Industries
IT Services & ConsultingConsulting
Employee ratings
48,765 reviews
3.5/ 5
Culture
3.6
Career growth
2.6
Work-life
3.6
Employees rate it well for
Salary10252Work Life Balance6251Work Culture5404Learning4530Appraisal3780
Find them on