Sail is the foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers. Everyone working at Sail will become an expert; nothing less will do in our immensely competitive market.
Optimize token processing down to the lowest layers of the stack. You'll optimize kernel performance, develop new scheduling and parallelism strategies, and help us squeeze every FLOP out of our hardware.
What you’ll do
Modify and extend state-of-the-art inference engines like vLLM and SGLang.
Understand every microsecond of GPU time spent during a forward pass. You'll be able to explain every kernel launch on an NSys profile.
Design and implement exotic parallelism schemes to work with "interesting" hardware topologies.
Write custom GPU kernels to excel in specific regimes, such as cascade attention
What we’re looking for
Strong understanding of LLM mechanics, like KV cache, mixture-of-experts, prefill vs. decode phases.
Interest in MLSys research - great ideas like speculative decoding and sparse attention come from research, that we need to follow closely.
Familiarity with modern, tile-based GPU programming, e.g. Triton, CUTLASS, ThunderKittens, etc. Or an interest in learning these!
Meet the CEO. This is the first step because we respect your time. Ask any question and get a definitive answer immediately.
Meet the CTO, who will ask about your experience, and share as much technical detail about Sail as you want to hear.
Come in to Sail's SF office for an interview day. Meet the whole team, then you'll have 3-4 hours to work on a problem that closely simulates the work we do daily. It's an objectively scored task, so you'll have immediate feedback on how well your code is working - just like we do in production! AI assistance is highly encouraged, and we'll provide a laptop with all the best tools set up. Finish with a short presentation describing your process, learnings, and results.
Offer. Once the team decides we want to work with you, we make a strong offer quickly and will be quite persistent over email/text/calls :)
We work out of a beautiful, sunny office in downtown San Francisco. All meals are on us (and actually great; SF is a food paradise and it would be a shame to eat only bowl slop). Everyone gets a Studio Display at their desk. We are serious about investing in anything that saves us time or energy. There are six different ways to make coffee or tea in the office. A friendly (hypoallergenic) black cat named Coco visits occasionally.
