MLOps / AI Infrastructure Engineer

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a MLOps / AI Infrastructure Engineer based in India. As an MLOps / AI Infrastructure Engineer, you will build and operate the systems that power production-scale machine learning and generative AI workloads. You will work at the intersection of software engineering, data science, cloud infrastructure, and AI research. Your work will span model deployment, serving architectures, automated ML pipelines, and infrastructure optimization. You will help turn experimental models into reliable, scalable, and low-latency production services. A key part of the role will be optimizing GPU and cloud resources to support demanding AI workloads efficiently. You will collaborate closely with data scientists and AI researchers in a technically challenging and fast-moving environment. This is an opportunity to have a direct impact on the reliability, performance, and scalability of modern AI systems.

Accountabilities

• Architect, build, and maintain scalable model deployment and serving pipelines for LLMs, deep learning models, and predictive analytics workloads.
• Develop production-grade model-serving architectures using technologies such as Triton, Ray, BentoML, or comparable platforms.
• Build and automate CI/CD pipelines covering data ingestion, feature management, model training, validation, deployment, and monitoring.
• Design and maintain reliable ML infrastructure capable of supporting large-scale AI and generative AI workloads.
• Manage containerized workloads and orchestration platforms, including Kubernetes, across cloud environments.
• Monitor GPU and CPU cluster utilization and identify opportunities to improve performance, availability, and resource efficiency.
• Optimize cloud infrastructure and compute expenditure for resource-intensive AI workloads.
• Partner closely with data scientists and AI researchers to transition experimental models into resilient, scalable, low-latency production services.
• Contribute to infrastructure automation, observability, reliability, and continuous improvements across the ML platform.

Requirements

• 4–8 years of professional experience in cloud infrastructure, DevOps, backend engineering, MLOps, or a closely related engineering discipline, with significant exposure to ML systems.
• Strong proficiency in Python and hands-on experience with Docker, Kubernetes, and Terraform.
• Practical experience working with cloud platforms and managed AI/ML services such as AWS Bedrock, Amazon SageMaker, Google Cloud Vertex AI, or equivalent technologies.
• Solid understanding of machine learning infrastructure, model deployment, model serving, and production ML lifecycle management.
• Hands-on familiarity with vector databases such as Pinecone, Milvus, Qdrant, or similar technologies.
• Experience with LLM orchestration frameworks and modern generative AI infrastructure.
• Understanding of CI/CD, infrastructure-as-code, containerization, monitoring, and production reliability practices.
• Strong problem-solving skills and the ability to troubleshoot complex infrastructure and performance challenges.
• Comfortable collaborating with data scientists, AI researchers, software engineers, and other technical stakeholders.
• Bachelor's degree in Computer Science, Engineering, or a related technical field is preferred.

Benefits

• Annual compensation of INR 1,800,000–2,500,000.
• Full-time employment opportunity.
• Remote working arrangement with flexibility to work remotely from India.
• Opportunity to work on large-scale machine learning and generative AI infrastructure.
• Exposure to modern AI/ML technologies, cloud platforms, GPU infrastructure, and model-serving systems.
• Significant technical ownership across deployment, automation, scalability, and infrastructure optimization.
• Collaborative environment working closely with AI researchers, data scientists, and engineering teams.
• Opportunity to develop expertise in rapidly evolving MLOps and AI infrastructure technologies.

How Jobgether Works We use an

AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.