Skip to main content

zaimler

ML Infrastructure Engineer

San Mateo, California, United States

Location
San Mateo, California, United States
Work
On-site
Employment
Full-time
Level
Mid level
Function
Data & AI
Pay
Not stated
Posted
15 months ago

Pay and the market here

89 data jobs open in San Mateo: 1% remote, 20 posted in the last 30 days.

Wondering how well you fit this one? OptiTalent Career checks each requirement against your own record, privately. About OptiTalent Career →

About the role

About zaimler

AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.

zaimler is the context infrastructure for the agentic era: a platform that automatically discovers domain knowledge, maps relationships, and gives AI agents the semantic understanding to operate with precision at scale. Imagine knowledge graphs that support real-time inference, built for systems that need to reason, not just retrieve.

zaimler was founded by Biswajit Das (ex-VP Engineering, Truera), a Data Infra veteran and former Chief Architect at Visa, and Sofus Macskassy (ex-Director of Engineering, LinkedIn), who built one of the largest knowledge graphs in production in the industry at LinkedIn. We're growing and deploying with major enterprises across insurance, travel, and technology. If you want to build infrastructure that the next decade of enterprise AI runs on, we'd love to talk.

About the Role

You'll own our inference and model-serving infrastructure end to end. This isn't a research role. It's a build role: you're setting up and scaling the systems that let our agents actually run in production, fast and reliably, at increasing concurrency.

You report to Sofus and work closely with our ML and infra teams.

What You’ll Own

  • Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
  • Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
  • Optimize and improve the engine builder and model server that power scalable agent orchestration

What You Need

  • Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
  • Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
  • Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
  • 3+ years of relevant experience. We care about capability, not tenure

Nice to Have

  • Ray / Ray Serve experience
  • Familiarity with AIBrix

Why Join

  • A rare chance to shape both company and product direction as an early team engineer
  • Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
  • Onsite culture in San Mateo, built for deep collaboration and high-velocity building
  • Full benefits (medical, dental, vision, 401k)
  • We sponsor H-1B visas and assist with immigration

We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.

Source

Posted by zaimler on their own hiring page, jobs.lever.co. OptiTalent shows it as published, read 07 Nov 2026 12:01 UTC; the original is the reference.

View the original ad ↗

More at zaimler

  • zaimler · New York, United States

    HybridFull-timeSeniorEngineering

    We're looking for a Forward Deployed Engineer to own the technical front line of our enterprise deals in NAMER (East Coast).

  • zaimler · San Mateo, California, United States

    On-siteFull-timeData & AI

    zaimler is building the next-generation semantic platform that links fragmented enterprise data and extracts meaning with knowledge-distilled models. We’re creating the foundation for AI systems that don’t just generate, but retrieve, link, and reason over enterprise knowledge.

  • zaimler · Bengaluru, India

    On-siteFull-timeSeniorSecurity

    We are seeking a Senior Security Engineer to strengthen the security posture of our cloud infrastructure and applications. This role is critical to proactively identifying and reducing risk, automating security controls, building a framework, and ensuring zaimler’s platforms…

  • Full Stack Engineer

    11 months ago

    zaimler · San Mateo, California, United States

    On-siteFull-timeEngineering

    Our platform is used by engineers, and engineers judge infrastructure by how fast it stops confusing them.