Asset Management - AI Systems Engineer – Associate/VP

Skip to main content.

View More Jobs

Asset Management - AI Systems Engineer – Associate/VP

Shanghai, China and 1 more

Apply Now

Job Information

• Job Identification210752658
• Job CategoryAI Research
• Business UnitAsset & Wealth Management
• Posting Date06/02/2026, 09:52 PM
• Locations501 Yincheng Middle Rd, Pudong New Area, Shanghai, 200120, CNF 19-20, No. 7 Jinrong Main Street, Beijing, 100033, CN
• Job ScheduleFull time

Job Description

Key Responsibilities

• Inference Platform & Optimization: Build and optimize enterprise LLM serving platforms (e.g., vLLM, TensorRT-LLM) using techniques like PagedAttention, continuous batching, and quantization (AWQ/FP8) for high throughput and low latency.
• GPU Pooling & AI Infra: Design GPU pooling, virtualization, and scheduling solutions on Kubernetes to maximize hardware utilization. Manage distributed training clusters and high-performance networking (RDMA/NCCL).
• Model Deployment & MLOps: Streamline the CI/CD pipeline for AI models. Implement automated benchmarking, zero-downtime deployment, and comprehensive observability (TTFT, TPS, GPU metrics).

Qualifications

• 1. Education & Experience:

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Computer Engineering, or a related field.

• 3+ years of experience in Backend Systems, Distributed Systems, or AI Infrastructure/MLOps, with at least 1-2 years specifically focused on LLM serving, GPU optimization, or ML Systems.

• 2. Core Engineering & Systems Skills:

• Expert-level proficiency in Python and strong proficiency in Java (essential for inference engines and CUDA integration).

• Deep understanding of Linux internals, networking, and distributed systems architecture.

• Hands-on experience with container orchestration (Kubernetes, Docker) and building custom K8s operators or controllers.

• 3. AI Infrastructure & Optimization Skills:

• Deep familiarity with LLM inference engines (vLLM, TensorRT-LLM, TGI) and understanding of their underlying architectural designs. Or

• Solid understanding of GPU architecture (NVIDIA Ampere/Hopper), CUDA programming, and GPU memory management. Or

• Experience with distributed training frameworks (DeepSpeed, Megatron-LM, Ray) and high-performance networking (RDMA, RoCE, InfiniBand).

• 4. Mindset & Soft Skills:

• A "hacker" mindset with a passion for squeezing every drop of performance out of hardware.

• Ability to collaborate effectively with AI Researchers (to understand their models) and Backend Engineers (to integrate AI into business systems).

• Preferred

• Contributions to open-source AI Infra projects (e.g., vLLM, Ray, PyTorch).

• Experience writing custom CUDA kernels or using Triton for operator fusion.

• Financial industry (Asset Management/Quant) experience is a plus.

• Language: Professional working proficiency in English to collaborate with global teams.

About Us

J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

About the Team

J.P. Morgan Asset & Wealth Management delivers industry-leading investment management and private banking solutions. Asset Management provides individuals, advisors and institutions with strategies and expertise that span the full spectrum of asset classes through our global network of investment professionals. Wealth Management helps individuals, families and foundations take a more intentional approach to their wealth or finances to better define, focus and realize their goals.​

Apply Now

Similar Jobs

• Asset Management - AI Algorithm Engineer - Associate/VP\ \ Shanghai, China\ and 1 more\ Posted on 06/03/2026\ \ Great opportunity to join JPMC

• Asset Management - Infrastructure Engineer - Associate/VP\ \ Shanghai, ChinaPosted on 07/14/2026\ \ We are seeking a Privileged Account Administrator to join our Information Technology Department. This role is responsible for systematizing privileged accounts that currently require manual input, implementing automation for login and password changes. Additionally, the position will support internal coordination with the Group and assist in organizing business meetings.

• Asset Management-Client Technology, Production Support Engineer-Associate/VP\ \ Shanghai, ChinaPosted on 06/16/2026\ \ Great opportunity to join AM tech team.

• Asset Management - Operations Technology, Production Support Engineer – Associate/ VP\ \ Shanghai, ChinaPosted on 11/28/2025\ \ Great opportunity to join JPMorgan.

• Careers

• Students

• How we hire

• Work with us

• Grow with us

I am an employee

IMPORTANT NOTICE: PLEASE READ CAREFULLY BEFORE USING THIS WEBSITE

Privacy Notice

AcceptDecline

Manage Preferences

Are You Still With Us?

It seems you've been gone for a while. For security reasons we will end your session automatically in 03:00 unless you would like to continue working.

End SessionContinue Working

Work Summary

This summary is generated by AI Assist. Click inside the summary text box to make changes as necessary.

DiscardAdd Summary

Page Asset Management - AI Systems Engineer – Associate/VP - JPMC Candidate Experience page Careers loaded

Digital Assistant

Ask Me Something