Senior AI/ ML Software Engineer


San Francisco
Permanent
USD160000 - USD180000
Development and Engineering
PR/580116_1771358851
Senior AI/ ML Software Engineer

We are seeking a Senior Software Engineer to join our AI Platform team, where you'll architect and build core infrastructure that powers model training, validation, deployment, and high‑scale serving. In this role, you'll work with modern AWS-native systems, focusing on low‑latency microservices, automated ML pipelines, and resilient deployment workflows that enable fast, safe delivery of machine learning models into production.

This is an ideal opportunity for an engineer who enjoys building platforms and tools that simplify complex ML workflows, and who thrives in a fast‑moving environment where engineering excellence, performance, and reliability matter.


What You'll Do

  • Build and maintain scalable systems and infrastructure for deploying and serving ML models.
  • Design low‑latency, fault‑tolerant model inference systems using Amazon SageMaker.
  • Implement safe deployment strategies such as blue/green rollouts, shadow deployments, and rollback mechanisms.
  • Develop CI/CD pipelines tailored for ML workflows and automated model promotion.
  • Monitor model performance and system health using AWS observability tools (e.g., CloudWatch, X-Ray).
  • Build internal tools, APIs, and self‑service interfaces to empower ML and data science teams.
  • Collaborate cross‑functionally with ML engineers, data scientists, and DevOps to productionize and scale new models.
  • Participate in code reviews, architecture discussions, and platform roadmap planning.
  • Continuously improve deployment reliability, speed, developer experience, and platform usability.

What You Bring

  • 4+ years of experience as a software engineer, including 2+ years working on low‑latency, highly available backend systems.
  • Bachelor's or Master's in Computer Science, Data Science, AI/ML, or a related technical field.
  • Strong fundamentals in data structures, algorithms, and distributed computing.
  • Proficiency in Python; experience with Go or Rust is a plus.
  • Hands‑on experience with ML model systems including inference services, model registries, and orchestration pipelines (preferably with SageMaker).
  • Solid understanding of MLOps best practices: model versioning, testing, deployment, reproducibility, and monitoring.
  • Experience building and maintaining CI/CD pipelines for ML workflows.
  • Familiarity with ML frameworks such as TensorFlow, PyTorch, and Scikit‑learn.
  • Experience with SQL or NoSQL databases, or cloud data warehouses (e.g., Redshift, Snowflake).

Preferred Qualifications

  • Experience building internal ML platform services or self‑service tooling.
  • Knowledge of model optimization: ONNX, TorchScript, quantization, batching, etc.
  • Experience with feature stores or real‑time feature serving systems.
  • Background deploying ML models into mission‑critical, high‑availability production environments.

FAQs

Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.

Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.

We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business. 

That's why we recommend registering your CV so you can be considered for roles that have yet to be created. 

Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.

Handpicked roles for you