lvl100Sign in

CACI

Senior Observability Engineer - Platform and Telemetry

  • Reston, VA, US; Rome, NY, US; Denver, CO, US
  • Full-time
  • $90,300-$189,600
  • Posted

Skills

  • AWS
  • CI/CD
  • Git
  • Go
  • Kubernetes
  • Linux
  • Microsoft Azure
  • Operations
  • Python
  • Teamwork
  • Troubleshooting

Job description

Job Title: Senior Observability Engineer - Platform and Telemetry

Job Category: Information Technology

Time Type: Full time

Minimum Clearance Required to Start: TS/SCI with Polygraph

Employee Type: Regular

Percentage of Travel Required: Up to 10%

Type of Travel: Continental US

Anticipated Posting End: 3/1/2027

The Opportunity:

The Senior Observability Platform Engineer—Platform and Telemetry Focus designs, deploys, operates, and improves the core observability platform. This role owns the technical foundation for secure telemetry collection, processing, storage, retention, resiliency, and platform self-observability across classified and disconnected OpenShift environments.

The engineer will support the approved telemetry architecture, including Elastic and Grafana, Prometheus, Loki, and S3-compatible object storage.

Responsibilities

Platform Deployment and Operations

•Deploy, configure, secure, upgrade, and operate the telemetry platform on Red Hat OpenShift.
•Build and maintain highly available telemetry ingestion, processing, storage, retention, backup, and recovery capabilities.

Telemetry Collection and Pipeline Engineering

•Design and operate collection pipelines for infrastructure, Kubernetes/OpenShift, application, security, cloud, CI/CD, and cost telemetry.
•Configure and maintain Grafana, OpenTelemetry Collectors, OTLP endpoints, exporters, receivers, processors, and/or Elastic ingest pipelines, as applicable.

Storage, Retention, and Resiliency

•Configure and manage metrics, logs, traces, and archival storage back ends.
•Implement data retention, compaction, lifecycle management, backup, restoration, and disaster-recovery procedures.

Platform Self-Observability and Security

•Implement telemetry and dashboards for ’s own health, including pipeline throughput, dropped samples, query latency, ingestion rate, storage utilization, component health, and resource consumption.
•Instrument pipeline components to capture throughput, queue depth, backpressure, dropped-record reasons, CPU and memory utilization, and end-to-end pipeline latency.

Collaboration and Documentation

•Partner with the Observability Architect, OpenShift DevSecOps Engineer, Security Engineer/ISSO, Data Engineer, and Grafana/SRE-focused engineer.
•Support reliable telemetry availability and data preparation for anomaly detection and other approved AI capabilities.

Qualifications :

Required:

•Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field; equivalent experience may substitute.
•7 years of experience in platform engineering, observability engineering.
•3 years of hands-on production experience with Kubernetes or Red Hat OpenShift.
•Hands-on experience with Elastic Stack, including Elasticsearch, ingest pipelines, index lifecycle management, storage tiers, and retention; and/or Grafana LGTM components including Alloy, Prometheus/Mimir, Loki, Tempo, and object storage.
•Experience with OpenTelemetry, OTLP, metrics, logs, traces, structured events, and telemetry data processing.
•Strong experience with Linux, containers, Helm, Kustomize, Git, GitLab CI/CD, Argo CD or OpenShift GitOps, and infrastructure-as-code.
•Experience with storage lifecycle management, backup/recovery, capacity planning, performance tuning, and distributed-system troubleshooting.
•Ability to automate with Bash, Python, Go, or a comparable language.

Desired

•Experience operating systems in air-gapped, classified, disconnected, or highly regulated environments.
•Experience with NIST SP 800-53, NIST SP 800-137, FIPS requirements, RMF/ATO processes, and secure software-supply-chain practices.
•OpenShift, Kubernetes, Grafana, Elastic, Prometheus, or OpenTelemetry certifications.
•Experience with S3-compatible object storage, OpenCost, FinOps telemetry, chargeback, or showback systems.
•Familiarity with AWS, Azure, hybrid-cloud telemetry, and enterprise identity/security tooling.

-

What You Can Expect:

A culture of integrity.

At CACI, we place character and innovation at the center of everything we do. As a valued team member, you’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground — in your career and in our legacy.

Pay Range :

There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.

Since this position can be worked in more than one location, the range shown is the national average for the position.

The proposed salary range for this position is:

$90,300-$189,600

CACI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.

Browse all jobs by role, city or company