AI Infrastructure Engineer

About Hydra Host

--------------------

Hydra Host is a Founders Fund-backed NVIDIA cloud partner building the infrastructure platform that powers AI at scale. We connect AI Factories-high-performance GPU data centers-with the teams that depend on them: research labs training foundation models, enterprises running production inference, and developer platforms demanding scalable compute capacity. We operate where hardware meets software-the bare metal layer where reliability, performance, and speed matter most.

The Role

------------

AI platform companies need more than raw GPU capacity. They need bare metal that's ready for their stack-Kubernetes clusters configured for multi-node inference, NVIDIA drivers tuned for their workloads, SLURM environments that work out of the box. Today, getting there requires white-glove onboarding. Your job is to change that.

As an AI Infrastructure Engineer, you'll work directly with AI platform customers to get their infrastructure running on Hydra. Work with platform partners (e.g., Northflank, Rafay, vCluster) to build reference deployments that provision through our API. You'll learn what breaks, what's missing, and what's harder than it should be-then work with Product and Engineering to turn those learnings into capabilities that ship in Brokkr, our core product. The goal is to move from bespoke deployments to fully automated onboarding at scale.

What You'll Do

------------------

• Get AI Platform customers production-ready on Hydra -standing up Kubernetes clusters, configuring GPU drivers, validating networking, and troubleshooting the issues that surface when real workloads hit real hardware.
• Own the bare metal u2190u2192 platform layer -bridging GPU infrastructure (NCCL, InfiniBand, NVLink, storage) with orchestration layers (Kubernetes, SLURM) and MLOps tooling that customers actually use.
• Configure, benchmark, and debug NVIDIA driver stacks -firmware versions, CUDA comp...