Data Engineer

We are seeking a seasoned Data Engineer with 5-7 years of experience in data engineering, cloud platforms and distributed systems, along with 2+ years of hands-on experience with Palantir Foundry/ AIP & Palantir Ontology.

The ideal candidate will work on designing scalable data solutions, building robust data pipelines, modelling enterprise datasets and enabling analytics and AI/ML use cases on Palantir Foundry. Experience in the insurance domain is a plus.

Role & responsibilities

• 5-7 years of overall experience in data engineering, building and maintaining large-scale data pipelines and platforms.
• 2+ years of hands-on experience with Palantir Foundry, including data ingestion, pipeline builder, transformations and working with Foundry datasets and applications.
• Experience building interactive applications using Foundry Workshop, Slate and custom frontends using TypeScript.
• Proficiency in programming languages such as Python, PySpark, and TypeScript/JavaScript.
• Strong experience with AWS services for data processing and storage (e.g., S3, Glue, Athena, Lambda, Redshift).
• Deep understanding of microservices architecture and distributed systems.
• Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch) and their integration into data pipelines.
• Experience with big data technologies like Snowflake.
• Strong problem-solving and performance optimization skills.
• Exposure to modern DevOps practices, including CI/CD pipelines and container orchestration tools like Docker and Kubernetes.
• Experience working in agile environments delivering complex data engineering solutions.
• Palantir Foundry certification or demonstrated project experience is highly preferred.
• Prior experience in the Insurance domain is highly desirable.

Preferred candidate profile