Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 18745310

    Octobit8 logo

    Prompt Engineer & AI QA Specialist

    Octobit8 · Remote · remote · Posted 31d ago

    Undisclosed2–7 yrsfulltimeSourced fromNaukri

    About a minute. You'll make an account on the way through.

    About this role

    Write, test, and systematically improve prompts for customer-facing agents-building evaluation sets that catch regressions before they reach production." , responsibilities:Design and iterate on system prompts, few-shot examples, and chain-of-thought structures.Build and maintain golden evaluation datasets per agent and deployment.Run adversarial and edge-case testing; document failure modes and mitigations.Collaborate with engineers to implement automated evaluation pipelines.requirements:2+ years working with LLMs in a product or research context.Structured approach to experimentation-hypothesis, test, measure, document.Python scripting for evaluation automation is a plus.


    Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

    Sourced from naukri

    Skills

    QAAutomationScriptingpython scriptingdeploymentPythonResearchArtificial Intelligence

    Prompt Engineer & AI QA Specialist · waiting for your command