Engineer, Senior Staff
Qualcomm · Bengaluru · onsite · Posted 28d ago
Undisclosed12–17 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Company: Qualcomm India Private Limited
Job Area: Engineering Group, Software Engineering
Job Overview The Qualcomm Cloud AI team is developing hardware and software for Machine Learning solutions spanning the data center, edge, infrastructure, automotive market. We are seeking ambitious, bright, and innovative engineers with experience in machine learning framework development. Job activities span the whole product life cycle from early design to commercial deployment. The environment is fast-paced and requires cross-functional interaction daily so good communication, planning and execution skills are a must.
We are seeking a highly skilled and motivated Language Model Engineer to join our team. The primary role of the engineer will be to train Large Language Models LLMs from scratch and fine-tune existing LLMs on various datasets using state-of-the-art techniques.
Responsibilities - Model architecture optimizations: optimize latest LLM and GenAI model architectures for NPUs, which involves reimplementing basic building blocks of models for NPUs
- Model Training and Fine-tuning: Fine-tune pre-trained models on specific tasks or datasets to improve performance. Implement state-of-the-art LLM training techniques such as Reinforcement Learning from Human Feedback RLHF, ZeRO (Zero Redundancy Optimizer), Speculative Sampling, and other speculative techniques.
- Data Management: Handle large datasets effectively. Ensure data quality and integrity. Implement data cleaning and preprocessing techniques. Hands-on with EDA is a plus.
- Model Evaluation: Evaluate model performance using appropriate metrics. Understand the trade-offs between different evaluation metrics.
- LLM metrics: Sound understanding of various LLM metrics like MMLU, Rouge, BLEU, Perplexity etc.
- AWQ: Understanding of Quantization is a plus. Knowledge on QAT will be a plus.
- Research and Development: Stay up to date with the latest research in NLP and LLMs. Implement state-of-the-art techniques and contribute to research efforts.
- Infrastructure development: For coming up with new optimization techniques to minimize ONNX memory footprint, export time optimizations.
- Collaboration: Work closely with other teams to understand requirements and implement solutions.
- Deep Learning Frameworks: Hands-on experience with PyTorch at a granular level. Familiarity with tensor operations, automatic differentiation, and GPU acceleration in PyTorch.
- NLP and LLMs: Strong understanding of Natural Language Processing NLP and experience working with LLMs.
- Programming: Proficiency in Python and experience with software development best practices.
- Data Handling: Experience working with large datasets. Familiarity with data version control tools is a plus.
- Education: A degree in Computer Science, Machine Learning, AI, or related field. Advanced degree is a plus.
- Communication: Excellent written and verbal communication skills.
- Work experience: Open, 4-10 years of relevant experience.
- Preferred Skills: Exp - 9+ to 12 years
- Optimization: Knowledge of optimization techniques for training large models.
Sourced from naukri
Skills
data qualityCudaFramework DevelopmentExportAutomotivedata handlingdata cleaningLarge Language Models (LLMs)Data Version ControlEvent DrivendeploymentcloudCommunication SkillsJavaArchitectureData ManagementDeep LearningArtificial Intelligence
About Qualcomm
Qualcomm
Semiconductors
22k+
employees
1996
30 years old
San Diego,California
United States
About
Qualcomm invents breakthrough technologies that transform how the world connects, computes and communicates.
Industries
SemiconductorsHardware & Networking
Employee ratings
1,207 reviews
3.7/ 5
Culture
3.4
Career growth
3.2
Work-life
3.3
Employees rate it well for
Work Life Balance267Salary160Work Culture155Learning100Senior Management91
Find them on