AI Software Development Engineer in Test (AI-SDET)

Who We Are At Network Solutions, we’ve been trusted for decades to help people get online and stay ahead. We’ve been here since the beginning of the internet, and we’re still building for what comes next. As the original digital identity authority, we help secure domain names, protect brands, and safeguard the infrastructure businesses rely on. We empower our customers to own and manage the assets that define them online, while delivering enterprise-grade security to protect against virtual threats. Our team leverages modern, AI-accelerated tools to streamline how businesses manage their digital presence, making the most of our decades of experience. The Network Solutions team is here to help online businesses protect what’s theirs and build for tomorrow. That’s why millions trust us to protect their domains, brands, and websites every day. Network Solutions is seeking an

AI-SDET to serve as a change agent for our QA Guild, introducing AI-powered tools, evaluation frameworks, and intelligent automation that modernize how our quality engineering team works. You will validate LLM outputs, RAG pipelines, and autonomous agent workflows while coaching and upskilling QA engineers on emerging AI practices. The ideal candidate brings 4–10+ years of engineering experience with 2–4 years focused on AI/ML, strong Python skills, and a proven ability to drive process change within engineering teams.

What You'll Do & How You'll Make Your Mark

• Change leadership and team enablement
• Champion the adoption of AI-powered testing tools and practices across the QA Guild.
• Identify gaps in current QA processes and introduce AI-driven solutions to address them, from automated test generation to self-healing frameworks.
• Run workshops, lunch-and-learns, and knowledge-sharing sessions to upskill QA engineers on AI tools and methodologies.
• Serve as the internal subject matter expert on AI quality standards, emerging tooling, and best practices.
• Collaborate with QA leads, engineering managers, and product teams to embed AI quality practices into the SDLC.
• AI and LLM quality engineering
• Design and maintain evaluation (Evals) frameworks covering hallucination detection, groundedness, toxicity, bias, prompt regression, determinism, and safety guardrail validation.
• Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, and embedding-based metrics.
• Validate RAG architectures including chunking strategies, embedding quality, retrieval accuracy, re-ranking, and vector search relevance.
• Test multi-agent orchestration workflows, agent memory and context retention, and MCP (Model Context Protocol) integrations.
• Create synthetic and benchmark datasets for AI testing scenarios.
• Evaluate latency, token usage, model cost, throughput, and scalability of AI systems.
• Automation engineering
• Develop and maintain scalable UI and API automation frameworks using Python, Robot Framework, and Playwright/Selenium/Cypress.
• Automate testing across REST APIs, GraphQL, event-driven systems, streaming services, webhooks, microservices, and micro-frontend (MFE) architectures.
• Build reusable automation libraries, utilities, and AI-assisted testing workflows.
• Integrate automation and quality gates into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI/CD, Azure DevOps).
• AI platform and agent validation
• Validate AI agents built on LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, and OpenAI SDKs.
• Work with vector databases including Pinecone, Weaviate, ChromaDB, Qdrant, and FAISS.
• Validate AI workflows involving tool calling, function calling, agent planning and execution, structured outputs, and multi-modal systems.
• Monitor AI system behavior using observability, logging, and tracing platforms.
• DevOps, cloud, and reliability
• Work within Docker and Kubernetes environments.
• Perform cloud-based testing and deployments across AWS, Azure, OCI, and GCP.
• Validate distributed system reliability and resiliency.
• Contribute to shift-left and quality engineering best practices across the organization.

Who You Are What You'll Need To Succeed Must have

• Strong programming experience in Python.
• Deep understanding of software testing and quality engineering principles.
• Hands-on experience with AI/LLM testing, prompt engineering, context engineering, and AI Evals.
• Practical experience with RAG systems, AI agents, and vector databases.
• Experience with CI/CD pipelines, Docker, Kubernetes, and at least one major cloud platform (AWS, Azure, OCI, or GCP).
• Experience with API testing, microservices testing, and UI automation.
• SQL proficiency and data validation experience.
• Demonstrated ability to influence engineering teams and drive adoption of new tools and processes.
• Strong analytical, debugging, and troubleshooting skills.
• Experience working in Agile/Scrum environments.

Preferred

• Experience with Robot Framework and Playwright.
• Knowledge of LangChain, LangGraph, LlamaIndex, CrewAI, or Semantic Kernel.
• Familiarity with MCP (Model Context Protocol).
• Hands-on experience with developer AI tools such as Cursor, GitHub Copilot, Claude, or Gemini.
• Exposure to MLOps workflows, performance testing, security testing, or AI governance and compliance requirements.
• Experience with contract testing, chaos testing, or resilience engineering.
• AI Red Teaming or LLM security testing experience (prompt injection, jailbreaks, data leakage).
• Familiarity with accessibility testing and cross-browser/device testing.

EDUCATION Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field preferred. Equivalent hands-on experience and a demonstrable portfolio of projects are highly valued.

SUCCESS PROFILE The right candidate for this role is more than a strong engineer. We are looking for someone who:

• Actively experiments with AI tools and builds side projects, prototypes, or open-source contributions.
• Can bridge traditional quality engineering practices with modern AI-native approaches.
• Communicates clearly, influences without authority, and earns trust across engineering, product, and leadership teams.
• Brings a continuous improvement mindset and a bias toward action.
• Rapidly learns and applies emerging AI frameworks, tools, and architectures.

Why you’ll love us.

• We’ve evolved; we provide three work environment scenarios. You can feel like a Newfolder in a work-from-home, hybrid, or work-from-the-office environment.
• Work-life balance. Our work is thrilling and meaningful, but we know balance is key to living well.
• We celebrate one another’s differences. We’re proud of our culture of diversity and inclusion. We foster a culture of belonging. Our company and customers benefit when employees bring their authentic selves to work. We have programs that bring us together on important issues and provide learning and development opportunities for all employees. We have 20 + affinity groups where you can network and connect with Newfolders globally.
• We care about you. We provide excellent benefits from OSDE 310 Health Care, Monthly Salary Reviews, Tuition Reimbursement, Internet Reimbursement, In-company English Lessons, LinkedIn learning, Referral Program Bonus, F5 extra days off, Annual Bonus, and an opportunity to work on Global projects with Multicultural team.
• Where can we take you? We’re fans of helping our employees learn different aspects of the business, be challenged with new tasks, be mentored, and grow their careers. Unfold new possibilities with #teamnewfold! #NetworkSolutions

This Job Description includes the essential job functions required to perform the job described above, as well as additional duties and responsibilities. This Job Description is not an exhaustive list of all functions that the employee performing this job may be required to perform. The Company reserves the right to revise the Job Description at any time, and to require the employee to perform functions in addition to those listed above.