Senior Software Engineer-Senior Cloud Data Engineer

Senior Cloud Data Engineer

KEY ACCOUNTABILITIES:

• Administer, monitor, and support Confluent Kafka Platform environments, ensuring high availability, performance, scalability, and security.
• Install, configure, upgrade, patch, and maintain Kafka brokers, ZooKeeper/KRaft, Schema Registry, Kafka Connect, Control Center, Flink and REST Proxy.
• Deploy, manage, and troubleshoot Kafka Connect source and sink connectors including CDC, JDBC, S3/ADLS, IBM MQ, and REST connectors.
• Manage platform infrastructure on PAAS/IaaS environments (Azure, AWS, or On-Premises Linux servers), including capacity planning and performance tuning.
• Automate Kafka platform provisioning, deployment, and operational activities using Ansible and Infrastructure as Code practices.
• Monitor platform health, consumer lag, broker performance, connector status, and proactively resolve incidents and production issues.
• Implement security controls including SSL/TLS, RBAC, LDAP/AD integration, Secrets Management, and encryption standards.
• Perform disaster recovery testing, backup validation, platform upgrades, and infrastructure maintenance activities.
• Raise and manage ServiceNow incidents, service requests, change requests, and support audit/compliance requirements.
• Collaborate with application, infrastructure, cloud, and data engineering teams to onboard and support enterprise streaming use cases.

• Functions within the framework and boundaries of Group policies as well as overall organisational and governance frameworks.
• Authorised to take decisions as per the approved authorisation matrix.

Minimum Qualification

• 4-6 years of experience in Confluent Platform administration and support.
• Strong experience with Confluent Platform components including Kafka Brokers, Schema Registry, Kafka Connect, Control Center, and ksqlDB/Flink.
• Hands-on experience with Flink for stream processing and real-time data pipelines.
• Experience managing Linux-based infrastructure in Azure, AWS, or other IaaS platforms.
• Strong automation and scripting experience using Ansible, Shell Scripting, or Python.
• Experience with SSL, RBAC, LDAP, authentication, authorization, and Kafka security best practices.
• Knowledge of monitoring tools such as Prometheus, Grafana, Splunk, or ELK.
• Experience with CI/CD pipelines and infrastructure automation.
• Strong troubleshooting, problem-solving, and stakeholder communication skills.

Experience in implement application self-healing solutions through proactive and reactive automated measures