Data Platform Engineer

Talent500 is hiring for one of its clients.

About Itineris:

Itineris is a leading technology company that specializes in innovative SaaS solutions for water and energy utilities. Its flagship solution, UMAX, is a highly configurable Customer Information System (CIS) and CRM platform built on Microsoft Dynamics 365. UMAX enables utilities to streamline a wide range of operations – including customer service, field services, billing, asset management, and data analytics. Today, Itineris supports over 30 prominent utility providers across 7 countries and 11 U.S. states, serving more than 8 million customer accounts.

There's a saying at Itineris:Together goes a long way. And we live by that. Whether your job is translating our customers needs into the best software, selling, coding, or keeping our business running smoothly, we're united by the same mission: growing our company and delivering innovative software that empowers energy and water utilities to engage better with their customers.

UMAX is the brand name of our software solution for water and energy utilities. It automates their business processes and enables them to better engage with their customers. UMAX is a cloud-based solution, built on the powerful Microsoft Dynamics 365 platform.

Role Overview:

We are building a secure, scalable, and product-oriented data platform, called NEXUS, that becomes the backbone for analytics, operational data services, and AI/ML products. This role accelerates how our teams ingest, govern, activate, and innovate with data, reducing time-to-insight and enabling AI-driven applications responsibly.

As a Data Platform Engineer:

• You'll work closely be a part of a small, five-person Data & AI platform team, and partner with the AI Practice and UMAX Product / Engineering teams, with an initial focus on:
• Own our Apache Iceberg lakehouse end to end. REST catalog (Polaris) operations, table maintenance (compaction, snapshot expiry, orphan cleanup, sort clustering etc.), storage layout, and the merge-on-read vs copy-on-write tradeoff per table.
• Building and operating CDC / replication and batch + streaming ingestion pipelines for analytics, operational, and AI/ML consumers.
• Tuning the cost and performance of distributed compute and storage (incremental vs full rewrites, spot capacity, autoscaling, file sizing).
• Provisioning data-specific features (e.g. databases, feature stores, model registries)
• Deliver version-aware snapshots / SCD publish (cross-window deduplication, deterministic and auditable snapshot assembly, merges / upserts into well-contracted consumer stores).
• Enforcing data quality, lineage, and access / classification controls across batch & streaming.
• Orchestrating and operating scheduled, idempotent pipeline runs (failure recovery, retries).
• Offering well-contracted data stores and access APIs, built for portability across our multi-cloud (SaaS / hybrid / federated) footprint.
• Ship via GitOps and IaC (declarative deployment (ArgoCD / Helm), infrastructure-as-code (Bicep) — owning the pipeline, not just the code).

Qualifications:

• 5+ years in data infrastructure, platform engineering, or related backend roles.

Deep knowledge of:

• Deep Apache Spark internals: partitioning, skew, file sizing, join strategies, fluency in reading plans
• Lakehouse / warehouse design (Iceberg / Delta)
• Efficient storage design (partitioning, Z-ordering, compaction)Data replication & CDC, and batch + streaming ingestion (e.g. Kafka / Event Hubs / IoT Hub)
• Schema & data contract governance
• SQL & analytical data modelling (current state, SCD, merges / upserts, dimensional modelling)
• Proficient in Python, with strong software engineering and containerized application development (e.g. Docker / Kubernetes); comfortable building well-tested, modular, performant code. Infrastructure-as-code familiarity is a plus but secondary.
• Observability mindset: metrics, tracing, and logging for data systems.

Nice to Have:

• Operationalizing ML data: feature stores, model / feature serving contracts, drift / monitoring data (modeling itself stays with the AI Practice).
• Building prediction-serving, write-back, and feedback-label pipelines that connect model outputs back into UMAX (the NEXUS integration layer), to support AI/ML initiatives.
• Document stores (Cosmos DB, MongoDB).
• Experience with regulated / utility customer data.

What we offer:

• A fast-growing and international environment with offices in Hyderabad (India), Ghent (Belgium), Atlanta (USA), London (UK).
• Working with future-ready water and energy companies and building valuable utility expertise.
• Internal mobility, developing your career through various educational programs and growth paths.
• An entrepreneurial mindset where you have a direct impact on our growth journey.
• An open environment where we understand the importance of taking a break to recharge and achieve the best results. We make it a priority to celebrate milestones, both big and small.
• Onboarding, learning and buddy programs to get ready for a smooth start in your new job.
• A flexible and inclusive working environment – where people can just be who they are, and where we offer flexible options for hybrid working so you can work in a way that suits you best.
• Competitive perks & benefits, because we want to help you reach your full potential, both at work and in your personal life.
• A lot of fun moments with an eye for sports, celebration and wellbeing, important for maintaining a healthy work-life balance.