AI Software Engineer - AI Frameworks
Intel · Bengaluru · onsite · Posted 1d ago
Undisclosed6–11 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Responsibilities
Qualifications
Preferred Qualifications
Job Type
Shift
Primary Location
Work Model
We are seeking a dynamic and passionate AI software engineer to join Intel's Data Center and AI group (DCAI). In this role, you will design and develop optimizations for high-performance AI serving and training frameworks such as SGLang, vLLM, and PyTorch. You will contribute to Intel's AI framework software stack and help enable and optimize state-of-the-art solutions for Intel's AI accelerators and next-generation GPUs. This position requires deep expertise in framework internals, scheduling, memory management, and kernel optimization for production AI workloads.
Responsibilities
- Design and develop custom GPU kernels for AI framework operations including attention mechanisms, collective operations, and computation primitives to optimize performance on Intel accelerators and GPUs.
- Optimize and enhance framework components including scheduling, memory management, and execution pipeline architecture to improve throughput, latency, and resource utilization.
- Write and integrate high-performance kernels using GPU programming frameworks to maximize throughput and minimize latency.
- Identify and implement optimization opportunities in the framework stack for production AI workloads.
- Collaborate with the open-source community (SGLang, vLLM, PyTorch, and others), participate in upstream development, and integrate new innovations into production software.
- Debug and optimize complex multi-layered systems involving kernel execution, memory hierarchies, and distributed AI scenarios.
Qualifications
- Bachelor's degree (B.Tech) or Master's degree (M.S./M.Tech) in Computer Science, Electronics and Communications Engineering (ECE), or a related field, with 6 to 12 years of professional experience.
- Advanced proficiency in C++ (C++14/17) and intermediate skills in Python and parallel programming.
- Proven, hands-on experience writing and optimizing GPU kernels. Demonstrated expertise in kernel development for machine learning operations such as GEMM, attention mechanisms (including Flash Attention), collective operations, and sampling.
- In-depth, hands-on experience with AI frameworks-SGLang, vLLM, PyTorch, or similar production-grade serving and training systems. Deep understanding of their internal architecture, scheduling mechanisms, and memory management strategies is essential.
- Strong knowledge of AI inference and training concepts including batching strategies, memory optimization, distributed execution, and performance tuning.
- Practical experience optimizing and deploying AI models at scale in production environments.
- Strong ability to debug complex issues in multi-layered software systems, performance profiling, and bottleneck identification in AI frameworks.
- Solid understanding of computer architecture, GPU execution models, memory hierarchies, and hardware-software co-optimization techniques.
- Experience working on frameworks and platforms that have been deployed to production with high availability and performance requirements.
- Excellent communication skills and experience collaborating with cross-functional, geographically distributed teams.
Preferred Qualifications
- Extensive experience developing production-grade kernels with CUDA, CUTLASS, or Triton for various AI operations.
- Published or open-source contributions demonstrating kernel optimization expertise.
- Knowledge of compiler algorithms for heterogeneous systems and kernel fusion optimizations.
- Contributions to or deep familiarity with SGLang, vLLM, PyTorch, or other open-source AI frameworks.
- Experience with distributed AI workloads, multi-GPU scheduling, and optimization across heterogeneous hardware.
- Understanding of quantization techniques, mixed-precision inference and training, and their integration into AI frameworks.
Job Type
Experienced Hire
Shift
Shift 1 (India)
Primary Location
Bangalore, India
Work Model
This role will require an on-site presence.
Sourced from naukri
Skills
Kernel DevelopmentCudacomputer architecturecompilercomputationai modelsai frameworksKernelMemory managementGpu ProgrammingDebugCommunication SkillsAlgorithmsArchitecturecomplianceArtificial IntelligenceMachine Learning
About Intel
Intel
Semiconductors
13.0k+
employees
1968
58 years old
Santa Clara,California
United States
About
Intel pioneers semiconductor technology, impacting global advancement through innovative digital solutions and addressing significant challenges for customers.
Industries
SemiconductorsInternetHardware & Networking
Employee ratings
1,188 reviews
4.1/ 5
Culture
4.2
Career growth
3.4
Work-life
4.4
Employees rate it well for
Work Life Balance239Work Culture167Salary118Learning89Senior Management68
Find them on