TRM Labs
Staff MLOps Engineer, LLMOps
Share this job
Job Description
Build a Safer World.
------------------------
TRM Labs provides AI-powered intelligence solutions that help public and private sector agencies investigate and disrupt crime. TRM's platforms enable investigators to trace illicit activity, build cases, and construct operating pictures of threat networks. Leading agencies and businesses worldwide rely on TRM to make the world safer and more secure.
The AI Engineering Team is chartered with enabling next-generation AI applications, with a special focus on Large Language Models (LLMs) and agentic systems. Our mission is to build robust pipelines, high-performance infrastructure, and operational tooling that allow AI systems to be deployed with speed, safety, and scale.
We manage petabyte-scale pipelines, serve models with millisecond-level latency, and provide the observability and governance needed to make AI production-ready. We’re also deeply involved in evaluating and integrating cutting-edge tools in the LLM and agent space — including open-source stacks, vector databases, evaluation frameworks, and orchestration tools that unlock TRM’s ability to innovate faster than the market.
As a Staff MLOps Engineer with a focus in LLMOps, you’ll be at the core of building and scaling the technical infrastructure for AI/ML systems. You will:
- Build reusable CI/CD workflows for model training, evaluation, and deployment — integrating Langfuse, GitHub Actions, and experiment tracking, etc.
- Automate model versioning, approval workflows, and compliance checks across environments.
- Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling.
- Partner with engineering and data science to embed AI models and agents into real-time applications and workflows.
- Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML, etc.).
- Drive AI reliability and go...
Keep looking
Similar Remote AI Jobs
TRM Labs
Senior MLOps Engineer, LLMOps
ISPOT
VP, AI
Mayo Clinic
Principal AI/ML Engineer - AI Program
Mayo Clinic