* This position is open to candidates already in Canada, preferably in Quebec.

About the Company

Our hiring partner is redefining talent acquisition by creating conversational assessments that let candidates truly demonstrate their abilities. They’ve shown that technology can evaluate soft skills more accurately and fairly than traditional methods. Their mission is to help hiring teams make excellent decisions—ethically, efficiently, and confidently—through skills-first automation.

You’ll play a key role in advancing this mission while shaping the future of HR tech.

Your Mission

We’re looking for a Senior LLMOps Engineer to design and manage the infrastructure behind the next-generation conversational AI platform. You’ll ensure ML systems are robust, scalable, and efficient, enabling real-time, LLM-powered simulations that help global enterprises hire better and faster.

About the Project

The company is building an AI-driven platform that uses LLMs to simulate real conversations and evaluate communication, empathy, and decision-making skills.

As a core member of the project team, you’ll be responsible for ensuring the ML infrastructure is scalable, reliable, and efficient—supporting everything from experimentation to deployment.

What You’ll Do

Core LLM Infrastructure & Deployment

• Design, build, and maintain infrastructure for LLM-powered simulations using direct model serving (OpenAI, Gemini, Claude, local models) or orchestration frameworks such as LangChain.
• Develop and manage deployment and integration pipelines for both ML and backend services.
• Automate training, evaluation, and deployment workflows for prompts, agents, and scoring components.

Collaboration & Optimization

• Work closely with ML Engineers, Backend Developers, and Product Managers to define infrastructure needs and system architecture.
• Partner with Legal and Compliance to ensure all LLMOps practices meet GDPR and SOC 2 standards.
• Optimize cloud usage (AWS) for cost-efficiency and scale.
• Collaborate with the cloud optimization team to identify overspending and opportunities for cost reduction.

GDPR & SOC 2 Compliance

• Implement data pseudonymization and anonymization for all data used in LLM training, evaluation, and logging, especially PII, in line with GDPR requirements.
• Establish and enforce strict access controls across LLM infrastructure and data stores to meet SOC 2 Security and Confidentiality principles.

Monitoring, Logging & Reporting

• Implement and maintain monitoring, logging, and reporting systems for model and infrastructure performance.
• Ensure all logging and monitoring mechanisms are tamper-proof and include essential metadata (e.g., source, timestamp, model version) for operational debugging and compliance audits.

What Success Looks Like

• You’re passionate about transforming hiring through AI.
• You collaborate respectfully, challenge ideas with data and empathy, and contribute to a positive team culture.
• You continuously improve both systems and your own skill set.
• You deliver measurable impact on uptime, scalability, and cost efficiency.

Job Requirements

• 2+ years of experience in LLMOps, ideally within a SaaS or AI-driven startup.
• 5+ years of experience in cloud engineering.
• Strong experience with AWS, Docker, Kubernetes, Terraform, and Helm.
• Experience deploying and maintaining LLMs and conversational AI frameworks (e.g., Gemini API, OpenAI API).
• Experience integrating LLMs into rule-based or orchestration pipelines.
• Familiarity with monitoring and observability tools (Prometheus, Grafana, ELK, Datadog, etc.).
• Excellent problem-solving, analytical, and communication skills.

Salary & Benefits

The company offers a competitive salary, 100% remote flexibility, stock options, and a strong focus on long-term career development.

Why Join

• Shape an AI-driven product from the ground up with meaningful real-world impact.
• Work with a mission-driven, interdisciplinary team of ML engineers, linguists, and designers.
• Enjoy full remote flexibility, stock options, and a commitment to your long-term growth.
• Thrive in a diverse, inclusive environment where merit matters most.