lvl100Sign in

Johnson & Johnson

Principal AI Engineer, GenAI Platform Operations

  • Raritan, New Jersey, United States of America
  • Full-time
  • Posted

Skills

  • AWS
  • Cybersecurity
  • ITIL
  • Large Language Models
  • Leadership
  • Machine Learning
  • Microsoft Azure
  • Operations
  • Robotics
  • Supply Chain
  • TypeScript

Job description

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world.  We provide an inclusive work environment where each person is considered as an individual.  At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function:

Technology Product & Platform Management

Job Sub Function:

Intelligent Automation Engineering

Job Category:

Scientific/Technology

All Job Posting Locations:

Raritan, New Jersey, United States of America

Job Description:

We are searching for the best talent for a Principal AI Engineer, GenAI Platform Operations to be located in Raritan, NJ

Principal AI Engineer, GenAI Platform Operations

Job title  Principal AI Engineer, GenAI Platform Operations

Category  Principal AI Engineer, Functional Engineering (ST7)

Location  Raritan, New Jersey, United States of America

Work pattern  Hybrid Work

Description

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function:

Technology Product & Platform Management

Job Sub Function:

Functional Engineering

Job Category:

Scientific/Technology

All Job Posting Locations:

Raritan, New Jersey, United States of America

Job Description:

At Johnson & Johnson, we believe health is everything. We're tackling the world's toughest health challenges, building a world where complex diseases are prevented and cured, treatments are smarter and less invasive, and solutions are personal. Across Johnson & Johnson Innovative Medicine and Johnson & Johnson MedTech, our work is grounded in a single purpose: changing health for humanity. Johnson & Johnson is ranked #1 in healthcare across S&P 500 companies in the AIDE Institute's AI adoption index, which assesses how AI is applied in practice across workforce, operations and business outcomes, including work in surgical robotics, digital surgery analytics and imaging systems. At J&J, AI accelerates innovation, improves how we operate, and delivers better outcomes for patients.

The Principal AI Engineer, GenAI Platform Operations is the senior technical authority for how agents run on the enterprise GenAI platform: you set the operations strategy and build the capabilities that observe and control agents in production. That platform includes the MCP (Model Context Protocol) Gateway, the agentic runtime, conversational AI and content-generation services, and Enterprise Knowledge Graph and GraphRAG retrieval services, deployed across Microsoft Azure and AWS and relied upon by scientific, commercial, supply chain and manufacturing teams across our segments. As agents move from pilots into production, keeping the platform available is no longer enough: we need to know what every agent is doing, how well it is performing, and how to intervene while it runs. This is a hands-on technical leadership role: you define that strategy and design and build the control capabilities that deliver it: observability and performance telemetry for agents, a map of agent performance and dependencies across the estate, reliability checks carried out by agents rather than by hand, and a runtime control plane that can throttle, pause, roll back or stop an agent, a tool or a model in seconds, including a tested kill switch. You also own agent lifecycle management at runtime, from registration and promotion through versioning, suspension and retirement, and you lead the platform's support and incident management teams. Because this platform supports regulated and patient-adjacent work, these controls are a quality and safety obligation as much as an engineering one, and you will partner closely with Quality and Compliance and with Information Security & Risk Management (ISRM) so that every control is validated, every control action is traceable, and the platform remains inspection-ready.

You lead the GenAI platform support and incident management teams, and you work with the site reliability, operations and platform engineers, setting the technical standards they operate to and mentoring them through the hardest failure modes. You set the runtime readiness criteria every agent must meet before it is promoted to production, and you turn agent performance signals, including quality regressions, failing tools, unreliable dependencies, runaway cost and unsafe behavior, into prioritized input for the Azure and AWS platform engineering, agentic engineering, model engineering, and AI security and governance teams. Guided by Our Credo, you build an inclusive work environment where each person is considered as an individual, diversity and dignity are respected, merit is recognized, and on-call and escalation work is distributed justly and sustainably.

This position will report into the Senior Manager, TS GenAI platform engineering.

Key Responsibilities:

·       Define and own the GenAI platform operations strategy and roadmap — the operating model for running agents in production across Azure and AWS, the observability and control capabilities the platform needs, and the sequence for building them — and publish the agent operations review that turns performance, reliability, risk and cost trends into prioritized platform commitments.

·       Build the agent observability platform — end-to-end traces across multi-step agent runs, gateway-mediated MCP tool calls, model calls and retrieval, built on OpenTelemetry and its generative AI semantic conventions — and define the instrumentation contract every agent must implement before it reaches production.

·       Monitor agent performance in production: task completion, answer quality and groundedness from online evaluation, tool-call and MCP success rates, latency, token use and cost per task, guardrail interventions, and drift or regression against each version's baseline — with SLOs and error budgets set per agent and per risk tier.

·       Map agent performance across the estate: an authoritative agent registry linking each agent to its owner, versions, tools, MCP servers, models, data sources and risk tier; dependency maps that show blast radius; and performance scorecards that let consumers and governance compare agents and act on the weakest.

·       Agentify reliability checks: design and deploy operations agents that run health checks, synthetic probes, anomaly triage, evidence gathering and first-line remediation, with defined autonomy limits, human approval for consequential actions and complete audit trails — reducing manual toil and time to detect.

·       Build the runtime control plane that influences the platform while it runs — kill switches at agent, tool, MCP server, model and platform level; circuit breakers, rate limits, budget caps, throttling and quarantine; and policy enforcement at the gateway — validated under GxP-compliant change control with Quality and Compliance and ISRM, tested regularly, and with every control action recorded as inspection-ready evidence.

·       Own agent lifecycle management at runtime: registration and admission, runtime readiness gates, promotion between environments, versioning, canary and shadow releases, automated rollback on regression, suspension, deprecation and retirement — so no agent runs in production without an owner, a version and an off switch.

·       Lead the GenAI platform support team for reliability: L1 and L2 intake, triage runbooks, routing and escalation to L3 engineering, response and resolution commitments, knowledge articles and known-error records — feeding recurring issues back to engineering and documentation, SDK and onboarding gaps to the team that owns the developer-facing surface.

·       Lead the incident management team: major incident command, severity classification, bridge coordination, stakeholder communication and restoration, using the runtime control plane to contain agent incidents; and chair blameless reviews and problem management until recurring failure modes are engineered out, with corrective actions owned and closed.

·       Lead, hire, coach and develop the support, incident management and reliability engineers in an inclusive, Credo-grounded environment — with an equitable, sustainable on-call rotation — and manage the cloud, observability and agent operations vendors and the managed service provider for L1 support.

Qualifications:

·       Minimum of 10 years of progressive technology experience, including at least 5 years in enterprise-scale services, and 3 years of formal people leadership managing engineering, operations or support teams.

·       Minimum of a Bachelor's degree in Computer Science, Engineering, Information Systems or a related technical discipline; Master's degree preferred.

·       Demonstrated experience defining and technically delivering an operations, reliability or observability strategy and roadmap for a platform serving multiple internal consumer teams.

·       Track record of designing and building observability platforms — tracing, metrics, logs, alerting and service health reporting — and using that data to drive engineering prioritization.

·       Practical experience operating AI, machine learning or LLM-based services in production, including monitoring their quality and performance, not only their availability.

·       Experience building runtime controls for production systems, such as feature flags, circuit breakers, rate limiting, traffic management, emergency stop or automated rollback.

·       Hands-on operational experience with workloads running on Microsoft Azure and/or AWS, including containerized services and managed data and networking services.

·       Experience operating technology in a regulated environment, with working knowledge of GxP change control, computer system validation, and the evidence expected in internal audits or health authority inspections.

·       Experience automating operational work at scale, including health checks, triage and auto-remediation, and reducing toil through engineering.

·       Demonstrated accountability for a 24x7 production service, including running ITIL-aligned incident and problem management and an L1/L2 support function for a platform serving multiple internal consumer teams.

·       Experience building and leading support, incident management or reliability teams, including hiring, coaching, performance management and creating an inclusive environment where each person is considered as an individual.

·       Ability to explain agent behavior, risk and control decisions clearly to senior Technology, business, Quality and governance stakeholders, including when an agent must be paused or stopped.

·       Willingness to participate in an escalation rotation supporting a 24x7 platform, including runtime control dec

Browse all jobs by role, city or company