Data Engineer

Just Now Data Engineer IBM Mumbai, Maharashtra, India Ai Recommended 0% Match Score

About The Job IBM is hiring for the role of Data Engineer!

Your Role And Responsibilities

• Your primary responsibilities include:
• Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
• Strive for continuous improvements by testing the build solution and working under an agile framework.
• Discover and implement the latest technologies trends to maximize and build creative solutions

Required Technical And Professional Expertise

• Experience with Apache Spark (PySpark): In-depth knowledge of Spark’s architecture, core APIs, and PySpark for distributed data processing.
• Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modelling, and data warehousing concepts.
• Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
• SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
• Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage system