Data Platform Engineer

Project Role :Data Platform Engineer



Project Role Description :Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills :PySpark



Good to have skills :NA
Minimum
3 year(s) of experience is required



Educational Qualification :15 years full time education


Summary:
As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform architecture, ensuring that all components align with the overall blueprint. This role requires close collaboration with Integration Architects and Data Architects to facilitate seamless integration across various systems and data models. The position demands a proactive approach to understanding the evolving data landscape and supporting the platform s scalability and efficiency through thoughtful design and coordination.

Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to ensure alignment of data platform components with business requirements.
- Assist in identifying potential improvements and optimizations within the data platform environment.
- Support junior team members by sharing knowledge and providing guidance on platform-related tasks.

Professional & Technical Skills:
-

Must To Have Skills:

Proficiency in PySpark.
- Experience in designing and implementing scalable data processing pipelines.
- Strong understanding of distributed computing concepts and big data technologies.
- Ability to work with complex data models and ensure data integrity across systems.
- Familiarity with cloud-based data platforms and integration techniques.
- Competence in troubleshooting and optimizing data workflows for performance and reliability.



Additional Information:
- The candidate should have minimum 3 years of experience in PySpark.
- This position is based at our INDC1A - NON-STPI location.
- A 15 years full time education is required.




Qualification
15 years full time education