LLM Prompt Specialist

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a LLM Prompt Specialist based in United States.

This role offers the opportunity to shape the future of AI-powered applications by designing advanced prompt strategies, agent workflows, and scalable LLM solutions. You will work at the intersection of software engineering, artificial intelligence, and product innovation, helping teams build reliable and responsible AI systems. The position focuses on creating reusable frameworks, evaluation methodologies, and best practices that enable effective adoption of large language models. You will collaborate with technical teams to improve AI capabilities, develop production-ready solutions, and influence engineering direction. This is an ideal opportunity for an experienced AI professional who enjoys solving complex problems and driving innovation in a rapidly evolving field. The role provides significant ownership, technical impact, and the chance to contribute to enterprise-scale AI transformation.

Accountabilities:: The LLM Prompt Specialist will define and lead the development of prompt engineering strategies, AI workflows, and technical patterns that support the creation of scalable LLM-powered applications. This role will combine hands-on engineering expertise with architectural thinking to improve AI capabilities across teams.

Design and establish prompt engineering strategies, reusable patterns, and best practices for LLM-based applications.

Build and optimize agentic workflows, prompt architectures, and AI-powered application frameworks.

Develop evaluation pipelines and methodologies to measure the quality, reliability, and performance of non-deterministic AI systems.

Create scalable solutions using modern LLM APIs, retrieval-augmented generation (RAG), embeddings, and vector databases.

Develop and deploy production-ready AI applications while ensuring performance, reliability, and responsible AI practices.

Partner with engineering teams to integrate LLM technologies into enterprise software solutions.

Provide technical guidance and mentorship to engineers working on AI-related initiatives.

Influence architectural decisions and define standards for AI application development.

Evaluate emerging LLM technologies and recommend appropriate approaches based on business and technical needs.

Ensure AI solutions follow responsible AI principles, including safety, compliance, and policy considerations.

Requirements:

The ideal candidate is an experienced software engineer and AI practitioner with a strong background in building and scaling LLM-powered applications. They should combine technical depth, communication skills, and the ability to guide teams through complex AI challenges.

Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related technical field.

6+ years of software engineering experience, including significant experience developing LLM-based applications.

Proven experience delivering AI-powered products or solutions into production environments.

Strong knowledge of modern LLM APIs, agent frameworks, and AI application architectures.

Hands-on experience with retrieval-augmented generation, embeddings, and vector database technologies.

Experience designing evaluation frameworks for AI systems with variable outputs.

Strong Python development skills and familiarity with modern application frameworks.

Understanding of responsible AI concepts, including safety, governance, and policy considerations.

Excellent written and verbal communication skills with the ability to explain complex technical concepts.

Experience mentoring engineers and influencing technical strategy.

Familiarity with multi-agent architectures, tool-use systems, fine-tuning workflows, and enterprise AI integrations is a plus.

Experience contributing through technical writing, public speaking, or open-source projects is a plus.

Benefits:

Competitive annual salary range of $100,000–$150,000 , based on experience and qualifications.

Fully remote position available across the United States.

Full-time direct employment opportunity.

Opportunity to work on innovative AI initiatives and enterprise-scale solutions.

Career growth opportunities within a technology-focused environment.

Collaborative culture focused on engineering excellence and continuous learning.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether?    Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.     #LI-CL1