1925 Science Aws Backend Software Developer jobs in California

Your Amazon package will include sign-on payments and restricted stock units (RSUs).

USA, CA, Cupertino - 165,200.00 - 223,600.00 USD annually

Health insurance (medical, dental, vision, prescription, Basic Life & AD&D; insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

An environment that celebrates knowledge-sharing and mentorship.

Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews.

Experience optimizing inference performance for both latency and throughput on such large models across the stack from system level optimizations through to Pytorch or JAX is a must have.

Bachelor's degree in computer science or equivalent

3+ years of non-internship professional software development experience

3+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience

Fundamentals of Machine learning and LLMs, their architecture, training and inference lifecycles along with work experience on some optimizations for improving the model execution.

Software development experience in C++, Python (experience in at least one language is required).

Strong understanding of system performance, memory management, and parallel computing principles.

Proficiency in debugging, profiling, and implementing best software engineering practices in large-scale systems.

Familiarity with PyTorch, JIT compilation, and AOT tracing.

Familiarity with CUDA kernels or equivalent ML or low-level kernels

Candidates with performant kernel development such as CUTLASS, FlashInfer etc., would be well suited.

Familiar with syntax and tile-level semantics similar to Triton.

Experience with online/offline inference serving with vLLM, SGLang, TensorRT or similar platforms in production environments.

Deep understanding of computer architecture, operation systems level software and working knowledge of parallel computing.

Your Amazon package will include sign-on payments and restricted stock units (RSUs).

165,200.00 - 223,600.00 USD annually

Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews.

Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D; insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

Experience in object-oriented languages like C++/Java is a must

3+ years of non-internship professional software development experience

2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience

Experience programming with at least one software programming language

Experience with compilers or building ML models using ML frameworks on accelerators (e.g., GPUs) is preferred but not required.

Experience with technologies like OpenXLA, StableHLO, MLIR will be added bonus!

Master's degree or PhD in Computer Science, or a related technical field.

3+ years of experience writing production grade code in object-oriented languages such as C++/Java.

Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators.

Experience with OpenSource compiler toolset like LLVM/MLIR.

Experience with the following technologies: PyTorch, OpenXLA, StableHLO, JAX, TVM, deep learning models, and algorithms.

Experience with modern build systems like Bazel/CMake.