Azure Data Engineer
Persistent Systems · Bengaluru · onsite · Posted today
Undisclosed5–10 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Azure DataBricks on Azure Databricks platform.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop high-quality code in PySpark, SQL, and other relevant technologies to ensure efficient data processing and analysis.
- Troubleshoot issues related to pipeline failures or performance problems.
Job Requirements :
- 5-10 years of experience in designing and developing big data solutions using Hadoop ecosystem (HDFS, YARN, MapReduce).
- Strong expertise in working with Azure Databricks platform including creating clusters, jobs, datasets etc.
- Proficiency in writing efficient Python code using PySpark framework for big data processing tasks.
- Experience with SQL querying languages such as T-SQL.
Sourced from naukri
Skills
PysparkSQLAzure Databricks
About Persistent Systems
Persistent Systems
IT Services & Consulting
22.2k+
employees
1990
36 years old
Pune, Maharashtra
India
About
With 23,900+ global team members across 19 countries, Persistent is a global services and solutions company delivering Digital Engineering and Enterprise Modernization.
Industries
IT Services & ConsultingTelecomFinTechHealthcareEmerging TechnologiesSoftware Product
Employee ratings
5,043 reviews
3.6/ 5
Culture
3.5
Career growth
3.0
Work-life
3.6
Employees rate it well for
Work Life Balance750Work Culture670Salary551Job Security439Senior Management397
Find them on