Senior Platform Engineer - Integration

Job Description:

Responsibilities:

• Collaborate proactively with internal support teams, vendors, and customers for enhancements and break/fix support.
• Complete key project work and support activities, prioritizing features and requirements based on business value and impact.
• Establish and follow best practices in the implementation and execution of support processes.
• Design and develop modern, API-based, and event-driven integrations between enterprise applications, leveraging RESTful principles and Confluent Kafka to build robust, scalable solutions that support both synchronous and asynchronous data flows.
• Build and support Kafka-based integrations in Python, including:
• Developing and maintaining producer and consumer clients (Python) for event publishing and stream consumption.
• Designing event payloads and enforcing contracts using schemas (e.g., Avro/JSON Schema) and Confluent Schema Registry.
• Working with Kafka topics (naming conventions, partitions, retention, compaction where applicable) in partnership with platform operations.
• Implementing reliability patterns (idempotency, retries, dead letter/error topics, replay/backfill strategies). Actively participate in code reviews and design discussions.
• Stay informed about new applications, features, and APIs to leverage them to solve business problems efficiently.

Experience:

• 6–8+ years of software engineering experience with proficiency in at least two programming languages; strong Python proficiency required (Java or C# a plus).
• Hands-on experience developing event-driven integrations using Kafka, with preference for Confluent Kafka.
• Experience building/maintaining Kafka producer/consumer applications, including message serialization and schema evolution practices.
• Extensive experience with integration technologies, including APIs, microservices, ETL, message brokers, and event-driven architecture, as well as standard formats and protocols (e.g., Avro, SOAP, REST, JSON, XML) to support both synchronous and asynchronous workflows.
• Strong Confluent Kafka development experience, including:
• Designing event models and managing topic strategy (throughput, partitions, ordering constraints, retention).
• Using Confluent Schema Registry (compatibility modes, schema evolution, versioning).
• Building robust producer/consumer patterns (delivery semantics, consumer groups, rebalancing considerations, error handling).
• Familiarity with Kafka tooling/observability (lag monitoring, metrics, logs, tracing) and troubleshooting production issues.
• Proven expertise with cloud platforms like AWS, hands-on experience with CI/CD pipeline tools (e.g., Jenkins, GitLab CI), and infrastructure as code (IaC) practices using tools like Terraform, applying DevOps practices within secure software development life cycles.
• Extensive experience with Kubernetes, Argo CD, Kafka, and Helm for containerization and orchestration, as well as monitoring tools (e.g., Grafana, Mimir) to ensure observability and operational efficiency.
• Strong understanding of API management (e.g., API Gateway, Apigee) with demonstrated experience in designing and implementing API gateways. Proficiency in relational and NoSQL databases (e.g., PostgreSQL, MongoDB) to support robust integration workflows.
• Deep understanding of event-driven architecture and experience in designing systems that use canonical data models and business objects for consistent and scalable data flows across enterprise applications.
• Knowledge of data security best practices and compliance standards (e.g., GDPR, HIPAA), as well as familiarity with role-based access control (RBAC) and identity and access management (IAM) practices.
• Experience working in Agile or Scrum environments with a strong emphasis on collaboration with cross-functional teams for effective and collaborative project delivery.
• Excellent communication, collaboration, and stakeholder management skills.
• Ability to prioritize and manage multiple tasks and projects in a fast-paced, dynamic environment.