Prompt Engineer & AI QA Specialist
Octobit8 · Remote · remote · Posted 31d ago
Undisclosed2–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Write, test, and systematically improve prompts for customer-facing agents-building evaluation sets that catch regressions before they reach production." , responsibilities:Design and iterate on system prompts, few-shot examples, and chain-of-thought structures.Build and maintain golden evaluation datasets per agent and deployment.Run adversarial and edge-case testing; document failure modes and mitigations.Collaborate with engineers to implement automated evaluation pipelines.requirements:2+ years working with LLMs in a product or research context.Structured approach to experimentation-hypothesis, test, measure, document.Python scripting for evaluation automation is a plus.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
QAAutomationScriptingpython scriptingdeploymentPythonResearchArtificial Intelligence