Senior AI Engineer, Agents

About EveryWatch

EveryWatch is the largest and most trusted data source in the secondary watch market. Established by a group of watch lovers, EveryWatch was created in response to the increasing popularity of luxury timepieces, with the aim of bringing unprecedented transparency and insight to the watch market. The first platform of its kind, EveryWatch combines all aspects of the watch world under one roof: a one-stop shop for watch collectors, vendors, and enthusiasts.

Were looking for Senior AI Engineer, Agents - an Agent Architect who will be responsible for designing, building, and scaling AI-powered solutions across EveryWatch. Working closely with our engineering, product, sales, and data teams, they will identify opportunities where AI and LLMs can automate complex processes, improve decision-making, and create new capabilities for our users and internal teams.

This is a highly hands-on role for someone who combines strong Python and LLM engineering skills with a creative, proactive mindset. You will not simply be given a roadmap. You will be expected to understand how the business operates, identify where AI can make a meaningful difference, propose new solutions, and take them from idea to production.

Our existing AI work, including WatchChat, provides a foundation to build on. The opportunity now is to expand that foundation into a broader ecosystem of intelligent agents that can work with EveryWatchs unique watch-market data and support collectors, dealers, sales teams, data operations, and engineering.

In short, were looking for someone who doesnt just ask, What can we build but What should we build

• Invent the agent roadmap. Sit with sales, data and product, find the repetitive expert work, and come back with a ranked list of agents worth building - with a real view on feasibility, cost and impact. This is the core of the job, and it doesnt stop after the first quarter.
• Build them yourself. You are hands-on. You design the architecture and you write the code - tools, loops, sub-agents, memory, state, evaluation. Not a spec-writer with a team underneath.
• Own the platform under the agents. Every new agent should be cheaper to build than the last: shared tool layer over EverWatch data (pricing, auctions, listings, references, portfolios), an MCP surface over our existing backend, shared memory, tracing, and a reusable eval harness.
• Harden WatchChat alongside us. Multi-turn state and memory, latency, cost, tool-call reliability, regression gates. Its live-bound and it has to stay right.
• Make quality measurable. Golden multi-turn datasets, programmatic verifiers for tool/argument correctness, LLM-as-judge on held-out sets. If we cant measure an agent, we dont ship it.
• Treat cost and latency as design constraints. Cheap models for routing and intent, strong models where they earn their keep; context budgets, caching, and - where it pays off - fine-tuning (SFT/LoRA on curated production trajectories) instead of ever-larger prompts.

Three things, and we wont trade any of them away:

1. Creative. You generate agent ideas the business hadnt thought of, and you can tell the difference between one that will work and one that demos well. You start from a use case, not a framework.
2. Strong architect. You can design an agent platform thats still standing in five years - state, memory, tool boundaries, sub-agent decomposition, evaluation, failure modes, cost. Youll be asked to critique our current architecture in the interview, and we expect you to find things.
3. Heavily hands-on. You ship. Deep production experience, writing the code yourself, at pace.

• 6+ years shipping production software, of which 2+ on LLM systems that real users touched.
• Real agentic depth: ReAct or equivalent loops, tool/function calling, planners, state checkpointing, long-term memory, HITL steps, streaming. Not "I called the OpenAI API."
• Hands-on LangGraph (or a strong argument for something better) plus a tracing/observability stack - LangSmith, Langfuse or similar.
• Python in production: FastAPI, async job processing, clean service boundaries.
• RAG done properly: retrieval + re-ranking + relevance judgement, and honest evaluation of all three.
• Evaluation as a habit, not an afterthought (RAGAS/DeepEval/GEVAL, LLM-as-judge, pass@k).
• Cloud production experience - AWS (Bedrock, SQS, EC2/EKS, S3) or equivalent - with Docker and CI/CD.
• The spine pushes back on us. We explicitly want someone who asks "why did you build it like that"

• LLM post-training: SFT with LoRA/QLoRA, preference/RL methods, reward and verifier design.
• Voice agents (LiveKit/Pipecat or similar), or vision-language work.
• Multi-agent orchestration and MCP integrations.
• Text-to-SQL over a real, messy production schema.
• Report/document generation agents - structured, sourced, client-ready output.
• Guardrails, PII handling, hallucination detection, risk scoring.
• Interest in watches, collectibles or market data. Not required - curiosity about the domain is.

• Ownership of EverWatchs entire agent layer, and the roadmap for it - not a corner of someone elses.
• A dataset that doesnt exist anywhere else, and users who care whether the answer is right.
• Direct line to the CTO; decisions in days, not quarters.
• Budget for models, tooling, and the coding agents you want to work with.
• Competitive compensation, remote-first.