Principal/Associate Director AI/ML Ops Engineer
Our client is expanding our team and looking for an experienced AI/ML DevOps Engineer with a strong background in Azure Cloud, Databricks, and DevOps methodologies to join their vibrant Data Science and AI team. This position offers an exciting opportunity to make a significant impact by driving automation, scalability, and delivering high-performance cloud-based solutions.
Role Responsibilities
Technical Leadership and Strategy:
- Spearhead the development of scalable AI/ML cloud architectures on Azure, ensuring the highest standards of reliability, security, and performance.
- Define and implement cloud infrastructure best practices, alongside DevOps strategies, to cultivate a culture focused on continuous technical improvement and excellence.
Solution Architecture and Design:
- Design and deploy Databricks workspaces and clusters to enable efficient data science and AI workloads at scale.
- Architect robust CI/CD pipelines for seamless AI/ML model deployment using tools like Jenkins, GitLab CI, or Azure DevOps, with an emphasis on automating testing and delivery.
- Optimize the deployment of containerized applications through Docker and Kubernetes, ensuring portability and scalability across environments.
Collaboration Across Teams:
- Partner with data scientists, Gen AI engineers, and software developers to enhance the development and deployment processes of AI/ML models.
- Act as a liaison between the infrastructure, data science, and software teams to align technical solutions with business needs.
- Contribute to code reviews, offer technical guidance, and mentor junior engineers within the AI & Data Science team.
Continuous Improvement and Innovation:
- Stay informed on the latest advancements in Azure, Databricks, and DevOps technologies, and integrate these innovations to optimize development and deployment workflows.
- Proactively identify opportunities to automate and streamline processes within the AI/ML pipeline.
- Lead internal workshops and knowledge-sharing sessions to promote a culture of continuous learning and ensure the team remains current with industry trends and best practices.
Required Qualifications and Skills:
- Bachelor's degree in Computer Science, Information Technology, or a related field; a Master's degree is preferred.
- 10+ years of experience in DevOps, Cloud Engineering, or a related role, with specific expertise in AI/ML workflows and data engineering.
- Extensive hands-on experience with Azure Cloud, including familiarity with Infrastructure as Code (IaC) tools like Terraform or Azure Resource Manager (ARM).
- Proven ability in managing Databricks environments for AI and data processing workloads.
- Proficiency in CI/CD tools such as Jenkins, GitLab CI, or Azure DevOps, and experience with scripting languages (Python, Bash, etc.).
- Strong experience with containerization technologies like Docker and Kubernetes for scalable deployments.
- Solid understanding of cloud security best practices and regulatory requirements.
Preferred Qualifications:
- Microsoft Azure certifications (e.g., Azure Solutions Architect, Azure DevOps Engineer Expert), Databricks certifications, or GenAI certifications.
- Expertise in AI/ML model lifecycle management and MLOps.
- Familiarity with Apache Spark, Delta Lake, and distributed computing environments.
- Experience with monitoring tools like Prometheus, Grafana, or Datadog.
- Knowledge of integration platforms as a service (iPaaS) such as Boomi, SnapLogic, or Workato.
This position offers a unique chance to contribute to cutting-edge AI and data solutions, making a tangible impact on the team's growth and success.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.