Source description
About the role

Senior AI Engineer
NYC
Engineering
In office
Full-time
Position Summary
We’re hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability—so agents do real work safely, quickly, and repeatedly.
What we’re looking for
- Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
- Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
- LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
- Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
- Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.
Responsibilities
- Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
- Create safety, cost, and latency controls; build dashboards and alerts for reliability.
- Partner with product/design to invent new interaction patterns and ship them fast.
- Document patterns and mentor engineers on best practices for LLM-powered features.
Nice to have
- Experience with workflow engines (e.g., Temporal), comfort in full stack engineering
Logistics
- Compensation: $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
- Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
- Benefits:
- Generous health, dental, and vision insurance
- 401k with 3% automatic contribution (no vesting)
- Paid Lunches
- Wellness and Citi Bike benefit
Ready to apply?
Powered by
First name *
Last name *
Email *
LinkedIn URL
Resume *
Click to upload or drag and drop here
Professional Personal Website
If there's a relevant professional personal website we should look at.
I understand that this is a 5-days in office role in NYC (midtown Manhattan) and that fits with what I am looking for.
We can be very flexible in every way EXCEPT this one for the right candidate.
Yes, I live in NYC and am
Yes, I do not live in NYC but am willing to relocate
No, but I would request an exception be made to allow me to work remotely
Are you authorized to work in the U.S.?
Yes
No
Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)?
Yes
No
Github
If you have a github with publicly visible projects please include a link here
What is your hottest tech take or most against the grain product decision you've made? *
Feel free to take this question in whatever direction you want - our goal is to understand how you can be opinionated and high ownership in your work. P.S. don't ask ChatGPT to write this for you. We look at LLM generated text all day and we'll know.
Apply
Req ID: R9
More at Raylu
Related open roles
Senior Data Engineer
New York · Onsite
Senior Full Stack Product Engineer
New York · Onsite
Senior Backend Engineer
New York · Onsite
Full Stack Product Engineer
New York · Onsite
Senior Product Designer (Founding Designer)
New York · Onsite
Senior AI Engineer
New York · Onsite

