BENGALURU · FULLTIME
data bricks engineer
eGlobal HR
Bengaluru · onsite · Posted 63d ago
Sourced from
Undisclosed12–19 yrsfulltimeBengaluru
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.4s
- Found the form on Naukri · 5 questions to answer1.8s
- Decided the answers for all of them2.2s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using ETL tools such as PySpark and Spark Streaming.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable solutions.
- Develop complex data models using Delta Lake and Unity Catalog to support business intelligence initiatives.
- Troubleshoot issues related to Kafka messaging queues, AWS services, Microsoft Azure resources.
Job Requirements :
- 12-19 years of experience in Data Engineering with expertise in ETL (Extract Transform Load) processes.
- Strong proficiency in Python programming language with experience working with libraries like Pandas, NumPy, Matplotlib.
- Experience with big data technologies like Apache Spark, Hadoop ecosystem components including HDFS, YARN & MapReduce.
Sourced from naukri
Section · 02
Skills
Apache SparkUnity CatalogstreamingApache KafkaDelta Live TableDeltaamazon web serviceseltpipelineDatabricksPysparkPythonETLMicrosoft AzureData ModelingAdvance SQL