SLM Training Engineer
- Milwaukee, Wisconsin, United States; Austin, Texas, United States; Houston, Texas, United States; Mayfield Heights, Ohio, United States
- Full-time
- Posted
Skills
Job description
Rockwell Automation is a global technology leader focused on helping the world’s manufacturers be more productive, sustainable, and agile. With more than 28,000 employees who make the world better every day, we know we have something special. Behind our customers - amazing companies that help feed the world, provide life-saving medicine on a global scale, and focus on clean water and green mobility - our people are energized problem solvers that take pride in how the work we do changes the world for the better.
We welcome all makers, forward thinkers, and problem solvers who are looking for a place to do their best work. And if that’s you we would love to have you join us!
Job Description
Job Description
Rockwell Automation is looking for an experienced SLM and Decision Model Training Engineer to build the small, fast, specialized models that make our enterprise AI agents reliable and affordable at scale.
This role sits within our AI Engineering organization and focuses on two model families: small language models (SLMs) fine-tuned for Rockwell domains and tasks, and decision models that return typed, calibrated judgments (choices, scores, and yes/no probabilities) instead of free-form text, in the style of System One models such as TypeSafe's Jev. These models will route requests, classify and triage work, act as guardrails on agent actions, and evaluate agent outputs, so that large language models are used only where open-ended reasoning is truly needed.
You have a proven track record of training, fine-tuning, evaluating, and deploying machine learning models in production, with a strong grounding in probability calibration and model evaluation.
This is a Hybrid role. You will report to the Director of Agentic AI.
Your Responsibilities
Key Technical Skill Expectations
Small Language Model Training: Fine-tune and adapt open-weight SLMs (e.g., Phi, Llama, Mistral, Qwen, Gemma) using supervised fine-tuning, parameter-efficient methods such as LoRA and QLoRA, and preference optimization (e.g., DPO), with frameworks such as PyTorch, Hugging Face Transformers, TRL, and DeepSpeed.
Decision & Discriminative Models: Build transformer-based classifiers, rankers, and scoring models (e.g., encoder models and cross-encoders) that output typed decisions over a fixed answer space, including multi-label, ordinal, and zero-shot setups where categories are supplied at inference time.
Calibration & Uncertainty: Apply probability calibration methods (e.g., temperature scaling, isotonic regression) and reward-based training for calibrated decisions, and measure calibration with reliability diagrams, expected calibration error, and Brier score.
Distillation & Data Engineering: Generate and curate training data, including LLM-labeled and synthetic data, apply knowledge distillation from larger teacher models, and manage data quality, bias, and label noise.
Evaluation & Benchmarking: Build offline and online evaluations that compare SLMs, decision models, and LLMs on accuracy, calibration, latency, and cost, and use LLM-as-judge and decision-model-as-judge patterns responsibly.
Model Optimization & Serving: Quantize and compress models (e.g., GGUF, ONNX, INT8/INT4), and serve them efficiently with tools such as vLLM, ONNX Runtime, Triton Inference Server, or Azure AI Foundry, including edge and on-premises deployment.
MLOps & Governance: Use MLflow or Azure Machine Learning for experiment tracking, model registry, CI/CD for models, monitoring, and responsible AI practices that comply with enterprise governance and security policies.
The Essentials - You Will Have
The Preferred - You Might Also Have
What We Offer
This position is part of a job family. Experience will be the determining factor for position level and compensation.
#LI-Hybrid
#LIfeAtRok
#LI-SB1
We are an Equal Opportunity Employer including disability and veterans.
If you are an individual with a disability and you need assistance or a reasonable accommodation during the application process, please contact our services team at 1 (844) 404-7247.
Rockwell Automation’s hybrid policy aligns that employees are expected to work at a Rockwell location at least Mondays, Tuesdays, and Thursdays unless they have a business obligation out of the office.