Backend AI Engineer

Senior Backend AI Engineer (7+ Years)

- Agentic AI, RAG, LLM Fine-Tuning Job Title: Senior Backend AI Engineer (Agentic AI, RAG, LLM Engineering)

Experience: 7+ years Role Summary We are seeking a Senior Backend AI Engineer with 7+ years of experience to design, build, and scale production-ready AI systems.

The role has a strong focus on Agentic AI platforms, Retrieval-Augmented Generation (RAG), and full LLM lifecycle ownership including training data preparation, fine-tuning workflows, and deployment/serving on cloud-native infrastructure. Key Responsibilities

• Own and build backend platforms for Agentic AI products, including autonomous workflows, orchestration, tool-calling, state and context handling, and safety guardrails.

• Design, implement, and optimize Retrieval-Augmented Generation (RAG) systems (chunking, embeddings, vector search, reranking, metadata filtering, freshness, and ranking quality evaluation).

• Develop and maintain LLM fine-tuning and training pipelines (dataset curation, preprocessing, labeling strategy, hyperparameter tuning, experiment tracking, and rollback strategy).

• Build scalable inference services for LLM and RAG workloads with high availability, low latency, and strict quality monitoring (hallucination, retrieval precision/recall, tool-call accuracy).

• Develop and operationalize AI APIs and microservices in Dockerized environments, including model serving stacks, vector store integration, and asynchronous event-driven processing.

• Design and manage Kubernetes deployment topologies, autoscaling policies, and disaster recovery for AI services.

• Create and own CI/CD workflows for model and application delivery (training jobs, image builds, infra changes, blue/green or canary releases, and post-deploy verification).

• Implement MLOps practices: experiment tracking, model versioning, canary validation, prompt and policy regression tests, observability, and performance benchmarking.

• Partner with product, data, and infrastructure teams to transform research prototypes into production solutions and drive roadmap decisions.

• Mentor engineers through code reviews, architecture sessions, and AI engineering best practices.

Required Skills and Technologies

• 7+ years of software engineering experience with strong backend ownership.

• Hands-on AI/ML engineering experience with LLM systems in production.

• Deep practical knowledge of Agentic AI frameworks and multi-step workflow engines.

• Strong experience with RAG architecture and vector search technologies (FAISS, Pinecone, Weaviate, pgvector, Milvus).

• Hands-on experience in LLM training and fine-tuning workflows (instruction tuning, domain adaptation, PEFT/LoRA/QLoRA, and parameter-efficient methods).

• Python (primary) with API frameworks such as FastAPI/Flask and asynchronous programming patterns.

• Containerization and orchestration with Docker and Kubernetes (Helm, ingress, secrets, HPA, resource quotas, monitoring).

• CI/CD ownership using GitHub Actions/GitLab CI/Jenkins and infrastructure-as-code patterns (Terraform/Ansible/Helm).

• Datastores and caching: PostgreSQL, Redis, and object storage, with exposure to NoSQL where needed.

• Cloud fundamentals on AWS/GCP/Azure (compute, container registries, IAM, networking, managed databases).

• Experience with observability stack (Prometheus, Grafana, OpenTelemetry, ELK/Opensearch, alerting).

Preferred / Plus

• Experience with MLflow, DVC, Weights & Biases, or equivalent experiment and dataset lifecycle tooling.

• Experience with serving stacks: Triton, vLLM, TorchServe, Text Generation Inference, BentoML, or equivalent.

• Experience with agent memory stores, retrieval quality benchmarking, and policy/safety layers for autonomous agents.

• Familiarity with Terraform, ArgoCD, or GitOps workflows for AI platform delivery.

• Security/compliance and governance awareness for AI systems (data privacy, prompt-injection controls, and auditability).

What We Expect

• Own complex AI backend features from design to production with measurable impact.

• Design systems for reliability, observability, and cost-aware scaling.

• Drive trade-off decisions across model quality, latency, and infrastructure costs.

• Communicate clearly with engineering, product, and leadership, and mentor other team members.