Senior Backend + AI Engineer
Shamrock · Bengaluru · onsite · Posted 1d ago
Not disclosed3–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Responsibilities:
- Ingest and process high-volume, multi-source data across enterprise systems.
- Validate stateful business workflows spanning loosely coupled services.
- Reconcile data across sources with consistency and correctness guarantees.
- Build event-driven, asynchronous pipelines for real-time and batch validation.
- Integrate with complex external systems (e. g., SAP, APIs, data warehouses).
- Deploying LLM-powered agents into production workflows.
- Designing systems to evaluate, monitor, and improve agent behavior over time.
- Building safeguards for correctness, reliability, and failure handling.
- Ensuring non-deterministic AI outputs meet deterministic system requirements.
Requirements:
- Production builder: You've shipped LLM-powered features real users depend on and debugged them when they broke.
- LLM practitioner: You understand hallucinations, retrieval failures, context limits, and what it takes to make agents deterministic enough for enterprise use.
- Systems thinker: You design for latency, failure modes, retry logic, and observability before features.
- Enterprise-aware: Data residency, compliance, audit trails, and deterministic guardrails are first-class design constraints for you.
- 3+ years in AI/ML or backend engineering with strong AI exposure.
- Hands-on production experience with LLM APIs (Anthropic, OpenAI, Cohere).
- Experience designing evaluation frameworks: automated evals, regression tests, or LLM-as-judge pipelines.
- Strong Python; experience with LangChain, LlamaIndex, or similar agentic frameworks.
- Familiarity with RAG architectures: chunking, embedding models, vector DBs, retrieval quality.
You'll own problems end-to-end: design → build → operate. Tech (evolving):
- Languages: Python, Go, Node.js .
- Data: Snowflake, Databricks, Postgres.
- Architecture: distributed systems, event-driven pipelines.
- Infra: containers, cloud platforms (Kubernetes / ECS / Cloud Run).
- AI: LLM-based agents with evaluation, monitoring, and control systems.
Sourced from instahyre
Skills
Large Language Models (LLMs)OpenAI SDKCohereBackendPythonAnthropic SDK
About Shamrock

Shamrock
₹4.1L PA avg
Avg at Shamrock
Employee ratings
10 reviews
2.4/ 5
Culture
2.2
Career growth
2.6
Work-life
3.0
Employees rate it well for
Overall Company24Work-Life Balance23
Find them on