The problem

Every voice conversation on our platform is a race against a latency budget: speech in, transcription, a language model, speech back out, all on GPUs, all in the time before a human starts to feel the lag. We run that pipeline across Africa and the Middle East, over noisy lines and real dialects, under infrastructure constraints most companies never have to design around. You'll own the systems that make it fast, reliable, and affordable at scale.

Why it's hard here

GPU is where the difficulty and the money live. You'll be orchestrating model serving across a GPU fleet, keeping it warm enough to hit latency targets and lean enough that cost-per-minute keeps falling. Scale-to-zero pools, warm spares, capacity strategy, and the observability to know what any of it is doing under load. This is the core of the job, not a side quest.

What you'll own

• Serving STT, LLM, and TTS models on GPU under hard latency budgets, and the fleet behind them

• Cost-per-minute as a first-class metric you're accountable for driving down

• Reliability, observability, and on-call posture across the whole platform

• Security and compliance for a multi-tenant system handling voice and PII across regions

• The major architectural calls, made independently and fast

What we're looking for

• 5+ years running infrastructure in production, not just building it

• Hands-on GPU inference serving at low latency, and managing GPU fleets and their cost

• Fluency with Kubernetes, cloud infra (AWS ideally), and infra-as-code

• Familiarity with the inference serving ecosystem (vLLM, Triton, TensorRT-LLM or similar)

• A track record of owning complex systems end to end, and shipping from zero with little

Nice to have

• Real-time or low-latency background: telephony, streaming, audio, or voice

• First infra hire or founding-era engineer at an early-stage startup

• FinOps instincts at scale

• Genuine interest in emerging markets or speech tech

The setup

You'll work directly with our CTO on a team of ~10 that ships constantly. High ownership, short path to decisions, no one leaving you alone when something breaks at 2am. London-based, in-office.