Source description
About the role
We’re looking for someone who loves open-source and collaborating with the OSS community but also has deep understanding in how transformers and Unsloth works.
_MUST COMPLETE CHALLENGES BEFORE APPLYING: _ https://x.com/danielhanchen/status/1891194528931209644
Must have:
Deep knowledge and implementation experience with multi-GPU training techniques such as FSDP
Important contributions to ML open-source projects (e.g., transformers, TRL, kernels, Unsloth) with reviewable code.
Heavy experience working with ML frameworks like Unsloth, Transformers, TRL, and PyTorch.
Familiarity with inference engines such as vLLM
Familiarity with low-level languages and kernels like Triton
Understanding of cloud services such as GCP or AWS (bonus).
Can be initially remote, with the ability to work in-person in San Francisco later.