LLM Inference

Work alongside researchers and engineers to implement frontier AI research ideas. Introduce new systems, tools, and techniques to improve model inference performance. Build tools to help debug performance bottlenecks, numeric instabilities, and distributed systems issues. Build tools and establish processes to enhance the team's collective productivity. Find ways to overcome roadblocks and deliver your work to users quickly and iteratively. Enjoy working in a fast-paced, design-driven product development cycle. Embody our Culture and Values. Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python Experience with generative AI. Experience with distributed computing. Python and Python ecosystem (eg. uv, pybind/nanobind, FastAPI) expertise. Experience with large scale production inference. Experience with GPU kernel programming. Experience benchmarking, profiling, and optimizing PyTorch generative AI models. Experience with open source inference frameworks like vLLM and SGLang. Working experience and conversant with the material in the JAX scaling book.