System Development Engineer - EdgeAI, HW Compute Group
Amazon · Bengaluru · onsite · Posted 1d ago
Not disclosed3–5 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Description
Are you passionate about running large AI models directly on consumer devices — where every millisecond, milliwatt, and megabyte matters Join our team to work at the core of the Neural Network Accelerator (NNA) software stack, driving on-device machine-learning inference, compiler and runtime development, and the automation infrastructure that ships production-quality AI features to millions of Amazon devices.
Key job responsibilities
As a SysDE I on the NNA / EdgeAI team, you will contribute to the software stack that compiles, deploys, and runs vision and language models on Amazon's in-house neural accelerators. You will work across the ML compilation pipeline (quantization, graph lowering, kernel selection, artifact packaging), the on-device inference runtime (secure and non-secure execution paths, memory and bandwidth budgets), and the release and validation infrastructure that keeps our device fleet healthy build over build.
A day in the life
You will help build and improve the test and evaluation systems that validate model accuracy, latency, memory footprint, and stability on physical devices in the lab — including large-scale evaluation of Vision-Language Models (VLMs) end-to-end from reference to device. You will also contribute to the build, release, and CI automation that keeps our multi-package software stack shipping cleanly across product platforms.
This role sits at the intersection of ML systems, embedded software, and release engineering.
Basic Qualifications
Company - ADCI - BLR 14 SEZ
Job ID: A10573481
Are you passionate about running large AI models directly on consumer devices — where every millisecond, milliwatt, and megabyte matters Join our team to work at the core of the Neural Network Accelerator (NNA) software stack, driving on-device machine-learning inference, compiler and runtime development, and the automation infrastructure that ships production-quality AI features to millions of Amazon devices.
Key job responsibilities
As a SysDE I on the NNA / EdgeAI team, you will contribute to the software stack that compiles, deploys, and runs vision and language models on Amazon's in-house neural accelerators. You will work across the ML compilation pipeline (quantization, graph lowering, kernel selection, artifact packaging), the on-device inference runtime (secure and non-secure execution paths, memory and bandwidth budgets), and the release and validation infrastructure that keeps our device fleet healthy build over build.
A day in the life
You will help build and improve the test and evaluation systems that validate model accuracy, latency, memory footprint, and stability on physical devices in the lab — including large-scale evaluation of Vision-Language Models (VLMs) end-to-end from reference to device. You will also contribute to the build, release, and CI automation that keeps our multi-package software stack shipping cleanly across product platforms.
This role sits at the intersection of ML systems, embedded software, and release engineering.
Basic Qualifications
- Bachelor's degree or above in computer science, computer engineering, or related field
- Experience working in a Linux/Unix environment
- Strong programming skills in one or more of C, C++, Python
- Experience with automating, building, testing, or deploying software
- Experience with CI/CD pipelines, build systems, and multi-package release engineering
- Familiarity with machine learning fundamentals — model formats, quantization, inference vs training
- Experience with on-device or embedded ML runtimes, ML compilers, or accelerator toolchains
- Experience with device-side debugging: kernel logs, driver logs, ADB, on-device tracing
- Familiarity with cloud infrastructure (AWS) for large-scale test execution, log storage, and metrics
- Familiarity with agent-based / AI-assisted developer tooling for triage, code review, or release automation
- Minimum 3 year of experience in ML systems, embedded software, or release engineering
Company - ADCI - BLR 14 SEZ
Job ID: A10573481
Sourced from foundit
Skills
Accelerator toolchainsDevice-side debuggingMulti-package release engineeringCI/CD PipelinescC plus plusUnixCloud InfrastructureBuild systemsmachine learning fundamentalsPythonML CompilersLinux
About Amazon
Amazon
Internet
120k+
employees
1994
32 years old
Hyderabad / Secunderabad, Telangana
India
About
Amazon is an American multinational technology company focusing on e-commerce, cloud computing, online advertising, digital streaming, and artificial intelligence.
Industries
InternetRetailUrban TransportLogisticsEmerging TechnologiesIT Services & Consulting
Employee ratings
31,409 reviews
3.9/ 5
Culture
4.0
Career growth
3.2
Work-life
3.8
Employees rate it well for
Work Culture3746Salary2936Work Life Balance2821Senior Management1830Career Growth1598
Find them on