Software Engineer II / III

Responsibilities:

• Design and build production-grade AI platform services: LLM gateways, MCP servers, and agent orchestration frameworks.
• Lead the design and implementation of Tekion's AI gateway, a unified abstraction layer for multi-provider LLM access with intelligent routing, fallback, cost optimisation, token budgeting, and comprehensive observability.
• Design and implement MCP (Model Context Protocol) infrastructure.
• Design agentic AI patterns, multi-step reasoning workflows, tool orchestration, guardrails, and human-in-the-loop escalation paths.
• Take end-to-end ownership of critical platform subsystems.
• Solve complex performance bottlenecks across inference and orchestration layers.
• Mentor junior and mid-level engineers.
• Communicate and collaborate with management, product, QA, UI/UX, and AI/ML teams.
• Deliver with quality, on time, in a fast-paced start-up environment.

Requirements:

• Bachelor/Master's in Computer Science or a relevant field.
• 5+ years of relevant software engineering experience.
• Strong sense of ownership.
• Excellent Java and object-oriented development skills.
• Experience in building and scaling microservices.
• Strong problem-solving skills, technical troubleshooting, and diagnosis.
• Expected to be a role model for young engineers with a strong sense of code quality and enforce code quality within the team.
• Strong knowledge in RDBMS and NoSQL technologies.
• Experience in developing backends for enterprise systems (eCommerce / manufacturing/supply chain, etc. )
• Excellent understanding of debugging, performance, and optimisation techniques.
• Experience with Java, MongoDB, MySQL, AWS technologies, ELK stack, Spring Boot, Kafka.
• Experience in developing large-scale cloud-native applications.
• Strong understanding of LLM fundamentals.
• Experience with or strong knowledge of MCP (Model Context Protocol), designing tool schemas, building MCP servers, tool discovery, and integrating MCP into agentic workflows.
• Understanding of AI gateway architecture: multi-provider LLM routing, semantic caching, load balancing, token tracking, cost allocation, fallback chains, and request/response logging.
• Familiarity with agentic AI frameworks: LangChain/LangGraph, LlamaIndex, CrewAI, OpenAI Agents SDK, or similar orchestration tools.
• Experience with LLM observability and evaluation tracing (LangSmith, OpenTelemetry), LLM-as-judge evaluation, cost and latency monitoring.
• Understanding of AI safety and guardrails: input/output validation, PII detection, content filtering, and hallucination mitigation.
• Demonstrated ability to deliver in a fast-paced environment.
• Good communication skills.