This role is for one of our clients
Compensation: $80 - $120 per hour
Employment Type: W-2 Employment
Work Commitment: Minimum 20 hours per week.
Availability: Consistent availability during weekdays.
Work Focus: AI model training, technical task development, infrastructure engineering evaluation, and expert feedback.
We are looking for experienced DevOps Engineers, Site Reliability Engineers (SREs), and Infrastructure Engineers to contribute to the development and evaluation of next-generation Generative AI models. This role offers an opportunity to leverage hands-on infrastructure and cloud engineering expertise to improve the technical accuracy, reliability, and performance of AI models.
The ideal candidate should have strong practical experience in cloud infrastructure, Kubernetes, containerisation, Infrastructure as Code (IaC), CI/CD automation, and site reliability engineering. The role involves designing real-world technical challenges, developing accurate solutions, evaluating AI-generated responses, and providing expert-level feedback to strengthen AI model capabilities in DevOps and infrastructure engineering.
This is a W-2 employment opportunity with the possibility of working as part of the extended workforce of a leading AI research organisation.
Requirements
Key Responsibilities
A. AI Model Training & Technical Expertise
•Collaborate with AI research and engineering teams to identify technical knowledge gaps and improve model performance across DevOps, SRE, cloud infrastructure, and platform engineering domains.
•Apply practical industry experience to evaluate the technical accuracy and effectiveness of AI-generated solutions.
•Provide expert guidance on infrastructure architecture, deployment strategies, system reliability, monitoring, and observability.
•Help improve AI models' ability to solve complex, real-world infrastructure and operational challenges.
B. Technical Task Development & Solution Design
•Design challenging, domain-specific technical tasks covering DevOps, cloud infrastructure, Kubernetes, and site reliability engineering.
•Develop accurate, well-structured solutions for complex infrastructure and automation problems.
•Create realistic technical scenarios involving Kubernetes manifests, Terraform modules, CI/CD pipelines, and infrastructure deployment workflows.
•Develop practical incident management, debugging, troubleshooting, and system recovery scenarios.
•Ensure technical tasks reflect real-world engineering practices and production environments.
C. Technical Evaluation & Quality Assessment
•Evaluate AI-generated solutions for technical correctness, scalability, efficiency, and practical applicability.
•Review infrastructure configurations, deployment pipelines, automation scripts, and cloud architecture designs.
•Identify errors, security vulnerabilities, reliability gaps, and performance bottlenecks.
•Provide detailed written feedback to improve the quality and accuracy of AI-generated technical outputs.
•Assess infrastructure solutions based on reliability, security, scalability, maintainability, and cost optimisation.
D. Evaluation Framework & Benchmark Development
•Develop structured evaluation rubrics to assess infrastructure design and implementation quality.
•Define benchmarks for Kubernetes orchestration, Infrastructure as Code, CI/CD automation, and cloud infrastructure management.
•Evaluate engineering trade-offs involving performance, security, reliability, and infrastructure costs.
•Collaborate with other subject matter experts to maintain consistency and accuracy across AI training and evaluation datasets.
Must-Have Skills & Qualifications
•4+ years of professional experience in DevOps Engineering, Site Reliability Engineering (SRE), Platform Engineering, or Infrastructure Engineering.
•Strong hands-on production experience with Kubernetes and containerisation technologies such as Docker.
•Expertise in Infrastructure as Code (IaC) tools such as Terraform, Pulumi, or AWS CloudFormation.
•Strong experience with at least one major cloud platform: AWS, Google Cloud Platform (GCP), or Microsoft Azure.
•Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, ArgoCD, or similar platforms.
•Strong scripting and automation skills using Python, Bash, or Go.
•Understanding of cloud infrastructure architecture, deployment automation, system reliability, monitoring, and observability.
•Demonstrated professional growth and experience handling complex infrastructure engineering responsibilities.
•Excellent written communication skills and the ability to explain complex technical concepts and engineering decisions clearly.
Good-to-Have Skills
•Experience with production-grade Kubernetes environments and container orchestration.
•Knowledge of cloud-native architecture, microservices, and distributed systems.
•Experience with monitoring and observability tools such as Prometheus, Grafana, and OpenTelemetry.
•Exposure to incident management, root cause analysis (RCA), and disaster recovery.
•Knowledge of cloud security, infrastructure governance, and cost optimisation.
•Experience working with AI/ML infrastructure, GPU workloads, or large-scale computing environments.
•Previous experience in technical mentoring, documentation, code reviews, or AI model evaluation.
Preferred Candidate Profile
The ideal candidate is a hands-on DevOps, SRE, or Infrastructure Engineering professional with strong production experience and the ability to apply practical engineering judgment to complex technical problems.