Senior AI Engineer

About Metaforms

Metaforms is redefining how market research gets done. Our AI platform empowers the world's leading research agencies to scale 10x faster while maintaining uncompromising quality. With AI Agents that augment survey programming, data processing, and project management, we help customers like Dynata, Savanta, and Borderless Access deliver more projects with less friction.

• 1,000+ surveys processed monthly

• Serving Fortune 500 companies across the globe

• Rapid month-over-month growth

Series A funded and growing fast, we're aggressively scaling our AI engineering team to build the next generation of production-grade AI agent systems.

The Role

We're looking for a Senior AI Engineer to own the design, development, and continuous improvement of the AI agent systems that power modern research operations.

This is a high-ownership, high-impact role at the intersection of applied ML and systems engineering. You'll work on hard problems — model reliability at scale, long-context handling, cascading error mitigation, and evaluation infrastructure — and you'll do it on a team that ships fast and takes quality seriously.

What You'll Own

Data Creation and Intelligence

• Design and own synthetic data generation pipelines that improve model performance on edge cases

• Develop evaluation datasets for domain-specific languages (DSLs) to systematically identify and close model weaknesses

• Build and maintain automated data quality checks and large-scale research data pipelines

Model Response Analysis and Monitoring

• Define structured rubrics for evaluating AI outputs on nuanced and ambiguous research tasks

• Build continuous monitoring, logging, and performance optimization systems for AI models in production

• Create tooling that enables domain experts to refine and evolve training datasets over time

System Architecture and Scale

• Lead research and implementation of solutions for long-context handling and cascading error challenges in LLM pipelines

• Design and evaluate production-grade AI agent systems end-to-end

• Drive prompt engineering strategy and experimentation frameworks across the team

What We're Looking For

Must-Have

• 4+ years of engineering experience, with at least 2 years focused on LLM systems or applied ML in production

• Deep hands-on experience with LLMs, synthetic data pipelines, evaluation frameworks, and AI system optimization

• Strong Python skills; Go or TypeScript a plus

• Solid understanding of prompt engineering, model fine-tuning, and evaluation methodology

• Experience building and operating production AI systems — not just prototypes

• Strong instincts for debugging complex, non-deterministic system failures

• High ownership: you drive problems to resolution independently and pull in others when needed

Nice to Have

• Experience with model monitoring, bias evaluation, or dataset management tooling

• Background in semantic parsing, DSLs, or structured output models

• Prior work on agentic systems, multi-step reasoning pipelines, or tool-use frameworks

Why Metaforms

• Work at the frontier of production AI — not demos, not experiments, but systems handling 1,000+ research projects a month

• Small, senior team where your decisions have real architectural impact

• Zero-bureaucracy culture: high autonomy, fast feedback loops, direct access to leadership

• Well-funded and financially stable, with a clear roadmap and the runway to execute on it

Benefits

• Full family health insurance

• $1,000 USD annual learning and development budget

• Dedicated mentor and coaching support

• Free Snacks and dinner at the office