lvl100Sign in

Analog Devices

Principal AI SoC Architect

  • US, MA, Boston; US, CA, San Jose, Rio Robles
  • Full-time
  • $200,000 to $275,000
  • Posted

Skills

  • Large Language Models
  • Python
  • RTL Design
  • Signal Processing

Job description

About Analog Devices

Analog Devices, Inc. (NASDAQ: ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate change, reliably connect humans and the world, and help drive advancements in automation and robotics, mobility, healthcare, energy and data centers. With revenue of more than $11 billion in FY25, ADI ensures today's innovators stay Ahead of What's Possible. Learn more at www.analog.com  and on LinkedIn and X .

About the Role

We are seeking an experienced and highly motivated SoC Architect to lead the architecture of next-generation high-performance, low-power Edge AI SoCs and the Neural Processing Unit (NPU) subsystems within them.

The ideal candidate will play a key role in building scalable SoC and AI acceleration solutions, enabling efficient execution of AI models on resource-constrained edge devices.

This role spans SoC architecture definition, NPU subsystem design, hardware/software co-design, AI workload optimization, IP evaluation and selection, and system-level performance tuning.

Candidates with strong experience in high-performance RISC-V CPU architecture or heterogeneous AI computing systems are highly preferred.

Responsibilities

•Own architecture definition for next-generation low-power Edge AI SoCs, including the NPU subsystem and its integration with CPU, DSP, sensing, memory, and interconnect
•Set and defend SoC-level power, performance, and area targets from early feasibility through architectural sign-off and tapeout
•Build the analytical and cycle-approximate models used to convert workload requirements into architectural budgets
•Define the NPU subsystem architecture, or select and integrate third-party NPU IP, covering:
•Compute organization and dataflow
•Memory hierarchy, buffering, and bandwidth provisioning
•Quantized inference (INT8/INT4/FP8) and sparse computation
•Transformer and attention acceleration, including KV cache handling
•Evaluate competing accelerator and processor IP, benchmark candidates against ADI workloads, and make make-versus-buy recommendations supported by documented analysis
•Drive hardware/software co-design with compiler, runtime, and AI software teams so the architecture is fully reachable from the production toolchain
•Define heterogeneous compute architectures spanning CPU, NPU, DSP, accelerators, and interconnect, and specify the memory and bandwidth provisioning each requires
•Work with product line, systems, and applications teams to translate customer workloads and product requirements into architectural specifications
•Own the multi-generation AI compute roadmap, tracking edge workload direction including small language models, multimodal and time-series reasoning, and on-device adaptation
•Analyze workload bottlenecks and optimize system-level power/performance/area (PPA)
•Represent ADI architecture in customer, partner, and IP vendor technical engagements

What We're Looking For

•Strong system-level thinking and architectural vision across hardware and software
•Sound engineering judgement on incomplete or early-stage data
•Ability to bridge hardware architecture and AI software ecosystems
•Ability to lead technical direction across multiple teams through influence
•Hands-on mindset with strong execution capability
•Self-driven and collaborative team player

Required Qualifications

•MS or PhD in Computer Engineering, Electrical Engineering, Computer Science, or related field
•12 years in SoC or processor architecture, including at least one low-power SoC taken from architecture definition through production silicon
•Direct hands-on experience in both SoC architecture and NPU or AI accelerator architecture
•Deep understanding of:
•Transformer architectures and LLM inference
•Neural network acceleration and dataflow architecture
•Memory hierarchy, bandwidth provisioning, and on-chip SRAM sizing
•Low-power design and power management techniques
•Demonstrated ownership of SoC-level PPA modeling and architectural tradeoff analysis
•Experience defining heterogeneous architectures integrating CPU, NPU, DSP, memory, and interconnect (AXI/AHB, NoC)
•Solid understanding of hardware/software co-design methodologies
•Familiarity with compiler and runtime stacks for AI acceleration
•Experience with RTL architecture and performance modeling, working with design and verification teams through tapeout
•Strong programming skills in C/C , Python, or similar languages

Preferred Qualifications

•Experience with high-performance RISC-V CPU architecture, vector extensions, or custom AI instruction extensions
•Experience with vector processors or SIMD/SIMT architectures
•Experience enabling LLMs or small language models on edge or embedded AI platforms
•Experience evaluating, licensing, or integrating third-party accelerator IP
•Background in sensing, signal processing, or mixed-signal systems
•Familiarity with chiplet, advanced packaging, NoC, or advanced memory architectures
•Experience with open-source NPU and AI acceleration ecosystems
•Patents, publications, or standards contributions

Why Join Us

You will define the architecture of Edge AI SoCs that bring LLM and generative AI inference to power-constrained automotive, industrial, healthcare, and consumer products. The role carries ownership of a multi-generation architecture roadmap, backed by the silicon, software, and sensing expertise across ADI to build it.

For positions requiring access to technical data, Analog Devices, Inc. may have to obtain export  licensing approval from the U.S. Department of Commerce - Bureau of Industry and Security and/or the U.S. Department of State - Directorate of Defense Trade Controls.  As such, applicants for this position – except US Citizens, US Permanent Residents, and protected individuals as defined by 8 U.S.C. 1324b(a)(3) – may have to go through an export licensing review process.

Analog Devices is an equal opportunity employer. We foster a culture where everyone has an opportunity to succeed regardless of their race, color, religion, age, ancestry, national origin, social or ethnic origin, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, parental status, disability, medical condition, genetic information, military or veteran status, union membership, and political affiliation, or any other legally protected group.

EEO is the Law: Notice of Applicant Rights Under the Law .

Job Req Type: Experienced

Required Travel: Yes, 10% of the time

Shift Type: 1st Shift/Days

The expected wage range for a new hire into this position is $200,000 to $275,000.

•Actual wage offered may vary depending on work location , experience, education, training, external market data, internal pay equity, or other bona fide factors.
•This position qualifies for a discretionary performance-based bonus which is based on personal and company factors.
•This position includes medical, vision and dental coverage, 401k, paid vacation, holidays, and sick time , and other benefits.

Browse all jobs by role, city or company