Padmi
Raylu logo
Raylu

AI origination platform · private markets

Senior AI Engineer

New York · OnsitePosted 7 days ago
Machine learningSeniorFull Time
Apply at Raylu

Opens the source posting on jobs.gem.com

Source description

About the role

View original

Company logo

View all jobs

Senior AI Engineer

NYC

Engineering

In office

Full-time

Position Summary

We’re hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability—so agents do real work safely, quickly, and repeatedly.

What we’re looking for

  • Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
  • Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
  • LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
  • Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
  • Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.

Responsibilities

  • Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
  • Create safety, cost, and latency controls; build dashboards and alerts for reliability.
  • Partner with product/design to invent new interaction patterns and ship them fast.
  • Document patterns and mentor engineers on best practices for LLM-powered features.

Nice to have

  • Experience with workflow engines (e.g., Temporal), comfort in full stack engineering

Logistics

  • Compensation: $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
  • Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
  • Benefits:
  • Generous health, dental, and vision insurance
  • 401k with 3% automatic contribution (no vesting)
  • Paid Lunches
  • Wellness and Citi Bike benefit

Ready to apply?

Powered by

Gem Logo

First name *

Last name *

Email *

LinkedIn URL

Resume *

Click to upload or drag and drop here

Professional Personal Website

If there's a relevant professional personal website we should look at.

I understand that this is a 5-days in office role in NYC (midtown Manhattan) and that fits with what I am looking for.

We can be very flexible in every way EXCEPT this one for the right candidate.

Yes, I live in NYC and am

Yes, I do not live in NYC but am willing to relocate

No, but I would request an exception be made to allow me to work remotely

Are you authorized to work in the U.S.?

Yes

No

Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)?

Yes

No

Github

If you have a github with publicly visible projects please include a link here

What is your hottest tech take or most against the grain product decision you've made? *

Feel free to take this question in whatever direction you want - our goal is to understand how you can be opinionated and high ownership in your work. P.S. don't ask ChatGPT to write this for you. We look at LLM generated text all day and we'll know.

Apply

Req ID: R9

More at Raylu

Related open roles

View all roles