Pyspark_Spark_Consultant

Job Description

We are looking for a skilled Spark Scala Developer with strong experience in big data technologies, data engineering, and distributed data processing. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines using Apache Spark with Scala, along with working on large datasets across cloud or on-premise environments.

• The role requires hands-on experience in data processing, ETL development, performance tuning, and working closely with cross-functional teams to deliver high-quality data solutions.

Roles & Responsibilities

• A day in the life of an Infoscion


• As part of the Infosys consulting team, your primary role would be to lead the engagement effort of providing high-quality and value-adding consulting solutions to customers at different stages- from problem definition to diagnosis to solution design, development and deployment.


• You will review the proposals prepared by consultants, provide guidance, and analyze the solutions defined for the client business problems to identify any potential risks and issues.


• You will identify change Management requirements and propose a structured approach to client for managing the change using multiple communication mechanisms.


• You will also coach and create a vision for the team, provide subject matter training for your focus areas, motivate and inspire team members through effective and timely feedback and recognition for high performance.


• You would be a key contributor in unit-level and organizational initiatives with an objective of providing high-quality, value-adding consulting solutions to customers adhering to the guidelines and processes of the organization.


• If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you!

Technical Requirement

• Primary skills:Domain->Finacle-Core-Functional->Finacle-Core-WMS->Grand Master,Technology->Big Data - Data Processing->Spark,Technology->Functional Programming->Scala


• Primary skills:Technology->Big Data - Data Processing->Spark,Technology->Functional Programming->Scala,Technology->Java->Apache

Additional Responsibility

• Good knowledge on software configuration management systems


• Strong business acumen, strategy and cross-industry thought leadership


• Awareness of latest technologies and Industry trends


• Logical thinking and problem solving skills along with an ability to collaborate


• Two or three industry domain knowledge


• Understanding of the financial processes for various types of projects and the various pricing models available


• Client Interfacing skills


• Knowledge of SDLC and agile methodologies


• Project and Team management

Educational RequirementBachelor of Engineering

Preferred SkillsTechnology->Big Data - Data Processing->PySpark,Technology->Big Data - Data Processing->Spark,Technology->Functional Programming->Scala

Service LineData & Analytics Unit