Principal Software Engineer
Principal Software Engineer (Gen AI / ML Platform)
New York, NY / Palo Alto
If you've been doing real work in Gen AI and are tired of roles where it's all talk and no execution, this is one of the more serious builds happening right now.
This team is scaling out a dedicated AI/ML platform and needs someone who can own it from a systems and engineering perspective. Not just experimenting with models, but actually standing up the infrastructure, deploying them, and making them work reliably at scale across a large environment.
This is a role for someone who understands the gap between building a model and running it in production - and enjoys solving that.
What you'll be doing:
- Designing, building, and scaling AI/ML infrastructure on AWS to support model serving and fine-tuning
- Taking Gen AI and LLM use cases from concept to fully productionalized systems
- Leading on LLM Ops, including model lifecycle management, monitoring, and optimization
- Working closely with data scientists, engineers, and product teams to bring models into real-world applications
- Leveraging tools like Databricks for data processing, model training, and deployment workflows
- Continuously improving performance, scalability, and efficiency across ML systems
- Acting as a technical leader within the team and mentoring more junior engineers
What they're looking for:
- 8+ years of experience in software engineering or ML engineering
- Strong background building and scaling systems on AWS
- Hands-on experience with Gen AI, LLMs, and model fine-tuning
- Proven track record of moving ML models into production environments
- Experience with LLM Ops or similar model lifecycle practices
- Familiarity with Databricks or comparable data/ML platforms
- Someone who can operate at a high level technically, but also influence direction and drive execution
This sits at the intersection of platform engineering and advanced AI - so you'll have ownership, visibility, and the chance to actually shape how AI is being deployed at scale, not just experiment with it in isolation.
If you're someone who likes building things properly - scalable, production-ready, and high impact - this is worth a serious look.
If you're even a maybe, feel free to reach out.
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.