Principal Edge AI Software Architect

We are seeking an experienced Edge AI Software Architect to lead the design and implementation of advanced machine learning solutions for edge devices and embedded systems. This role focuses on deploying and optimizing large language models (LLMs) and other AI models on resource-constrained hardware. Responsibilities: Architecture & Design Design and architect scalable Edge AI inference engines for microcontrollers, edge devices, and embedded systems Define technical roadmaps for deploying LLMs and foundation models on edge hardware Lead the architecture of model compression, quantization, and optimization pipelines for resource-constrained devices LLM & Large Model Optimization Optimize and deploy Large Language Models (LLMs) on edge devices using techniques such as quantization (INT8, INT4), pruning, and knowledge distillation Implement model compression techniques to reduce model size while maintaining accuracy for edge deployment Design and optimize inference pipelines for transformer-based models and other foundation models on low-power devices Develop custom kernels and operators optimized for edge AI accelerators Model Development & Deployment Train, fine-tune, and optimize machine learning models using TensorFlow, PyTorch, and ONNX for edge deployment Implement model conversion workflows (TensorFlow Lite, ONNX Runtime, TensorRT, OpenVINO) for various edge platforms Design and implement efficient model serving architectures for edge devices with latency and power constraints Performance Optimization Optimize ML algorithms and inference engines to meet strict performance, power, and memory constraints Profile and optimize model performance on various edge AI accelerators (NPU, DSP, GPU) Achieve low-latency, high-throughput inference while minimizing power consumption Requirements: Education Master's or Ph.D. degree in Computer Science, Electrical Engineering, Machine Learning, or related field Bachelor's degree with 8+ years of relevant experience may be considered Technical Skills Deep expertise in LLM optimization and deployment: quantization, pruning, distillation, LoRA, QLoRA Strong proficiency in ML frameworks: TensorFlow, PyTorch, ONNX, TensorFlow Lite, PyTorch Mobile Expert-level programming skills in C/C++ and Python Extensive experience in embedded software development and real-time systems Proven track record of deploying ML models (especially LLMs) to production edge devices Strong understanding of computer architecture, memory hierarchies, and hardware acceleration Professional Experience 5+ years of experience in embedded ML or Edge AI development Demonstrated experience optimizing and deploying large models (>1B parameters) on edge devices Proven ability to architect and deliver complex ML systems from concept to production Experience with model compression achieving >10x size reduction with minimal accuracy loss Soft Skills Excellent ability to read, understand, and implement research papers in English Strong problem-solving skills and architectural thinking Outstanding communication skills for technical documentation and cross-team collaboration in a global working environment Experience with multimodal models (vision-language, audio-text) on edge devices Contributions to ML optimization frameworks or edge inference engines Understanding of security considerations for edge AI deployment More information about NXP in Greater China... #LI-d6f4 NXP Semiconductors N.V. (NASDAQ: NXPI) enables a smarter, safer, and more sustainable world through innovation. As the world leader in secure connectivity solutions for embedded applications, NXP is pushing boundaries in the automotive, industrial & IoT, mobile, and communication infrastructure markets. For more information, visit www.nxp.com Bright Minds. Bright Futures. We believe that a key component to growing our business is to develop our people. To enable you to grow your career at NXP, we offer online and offline learning opportunities to help you develop some of your core and professional skills. Commitment At NXP. We recognize NXP is a powerful change agent as we continue to deliver innovative solutions that advance a more sustainable future. We remain steadfast in our commitment to sustainability and making measurable year-on-year progress. Also, we aim to create an inclusive work environment and we will not tolerate racism, discrimination or harassment of any kind. We have programs in place focused on diversity, inclusion and equality. Thank you for considering a career at NXP. To help you prepare for the different steps in our hiring process, see the following useful advice and tips. Are you already an NXP employee? Do not apply here. Instead, you must apply via our internal career page. Thank you for your interest in supporting our recruitment efforts. Please note that NXP operates under a strict Preferred Supplier List (PSL) for all recruitment activities. Any candidate profiles or resume submitted without a prior written agreement or explicit request from our Talent Acquisition team will be considered unsolicited. Such submissions will be deemed free of any obligations, and no fees will be paid by NXP or any of its affiliates, subsidiaries, or divisions - regardless of whether the candidate is hired, either coincidentally or otherwise. Thank you for your understanding.