Skip to main content

Maxinsights

Machine Learning Engineer (Video Foundation Models & Agentic AI)

Santa Clara, California, United States

Location
Santa Clara, California, United States
Work
On-site
Employment
Full-time
Level
Not stated
Function
Data & AI
Pay
Not stated
Posted
6 weeks ago

About the role

Job Description

About the Team

We are building Max VLM, a next-generation video foundation model designed to understand human activities, object interactions, and the physical world through first-person video.

Our mission is to develop intelligent video understanding systems that can accurately interpret complex real-world activities and turn continuous visual observations into structured, actionable information.

As a fast-moving startup team, we work across the entire machine learning lifecycle, from data collection and model training to evaluation, optimization, and production deployment. We combine state-of-the-art multimodal AI technologies with real-world data and practical engineering to build scalable, reliable, and efficient AI systems.

Project Overview & Technical Challenges

Despite rapid advances in multimodal large language models, understanding real-world video remains a challenging problem. Existing systems often struggle with fine-grained activity recognition, temporal reasoning, long-video comprehension, and computational efficiency.

Our team focuses on building high-performance video foundation models and bringing them into real-world applications. Key technical directions include:

1 - Video Foundation Models & Multimodal Understanding

Develop and improve video-language models capable of understanding complex human activities and physical-world interactions.

  • Fine-grained action recognition, temporal grounding, and video understanding.
  • Long-video comprehension, temporal reasoning, and event-level understanding.
  • Multimodal model fine-tuning, post-training, and performance optimization.
  • High-quality training data generation, automated labeling, and data selection.
  • Model evaluation, error analysis, and data-driven iteration to continuously improve production performance.

2 - Efficient Model Training & Deployment

Build scalable and efficient machine learning systems that support real-world product requirements.

  • Large-scale model training, fine-tuning, and distributed training optimization.
  • Efficient video processing, and inference acceleration. Model compression, quantization, and optimization of latency, throughput, and computational cost.
  • Production model serving, monitoring, and continuous performance improvement.
  • End-to-end optimization of model quality, reliability, and deployment efficiency.

3 - Agentic Video Understanding & Advanced Post-Training

Explore advanced AI techniques to improve video understanding and reasoning capabilities.

  • Develop agentic video understanding systems with autonomous tool use and multi-step reasoning.
  • Explore reinforcement learning and advanced post-training techniques to improve model performance.
  • Apply emerging AI research to real-world applications and product improvements.

Key Responsibilities

  • Design, train, fine-tune, and optimize video-language foundation models for real-world applications.
  • Build and improve large-scale ML pipelines covering data processing, training, evaluation, and inference.
  • Analyze model failures, identify performance bottlenecks, and drive continuous improvements through data and algorithmic iteration.
  • Develop efficient model inference and deployment solutions that balance quality, latency, and computational cost.
  • Collaborate closely with product and engineering teams to translate business requirements into technical solutions and deliver production-ready ML capabilities.
  • Explore and evaluate emerging techniques in multimodal learning, reinforcement learning, and agentic AI, applying promising advances to practical problems.
  • Take ownership of ML projects from problem definition and experimentation through deployment and ongoing improvement.

Qualifications

Minimum Qualifications

  • Bachelor's, Master's, or PhD degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field, or equivalent practical experience.
  • Strong understanding of deep learning and hands-on experience with model training, fine-tuning, or inference.
  • Proficiency in Python and deep learning frameworks such as PyTorch.
  • Familiarity with modern LLMs, multimodal models, or computer vision models.
  • Strong problem-solving skills and the ability to independently implement, debug, and optimize machine learning systems.
  • Ability to work in a fast-paced environment, take ownership, and deliver practical solutions to complex problems.

Preferred Qualifications

  • Strong research capabilities, demonstrated through publications at top-tier conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or other impactful research contributions.
  • Experience with video understanding, vision-language models, or multimodal foundation models.
  • Experience with LLM/VLM post-training, including SFT, reinforcement learning, or reasoning-oriented training.
  • Experience with distributed training, efficient inference, or production-scale ML systems.
  • Familiarity with agentic AI, tool-augmented reasoning, or multimodal reasoning.
  • Proven ability to translate novel research ideas into practical implementations and measurable improvements.

Why Join Us?

  • Real-World Impact: Build video AI systems that directly power real-world products and reach users through production deployment.
  • End-to-End Ownership: Work across the complete ML lifecycle, from data and model development to optimization and deployment, with the opportunity to own meaningful technical initiatives.
  • Challenging MIL Problems: Solve practical and technically challenging problems in video understanding, large-scale model training, and efficient inference.
  • Frontier AI Exploration: Stay close to advances in multimodal foundation models, reasoning, reinforcement learning, and agentic AI, with opportunities to apply new ideas to real-world problems.
  • Startup Environment: Work in a small, fast-moving team that values ownership, technical excellence, rapid iteration, and measurable impact.

Default Benefits

  • Health insurance
  • Vision care
  • Dental coverage
  • 401(k)
  • Paid holidays
  • PTO (Paid Time Off)
  • Sick leave

Source

Posted by Maxinsights on their own hiring page, jobs.ashbyhq.com. OptiTalent shows it as published, read 07 Nov 2026 05:03 UTC; the original is the reference.

View the original ad ↗

More at Maxinsights

  • Maxinsights · Santa Clara, California, United States

    On-siteFull-timeMid levelSales

    As a Key Account Executive, you will be a critical member of our commercial team, helping build our enterprise sales motion from the ground up. You will own and expand relationships with our most strategic customers—companies building the future of physical AI, robotics, and…

  • Maxinsights · Santa Clara, California, United States

    On-siteFull-timeEntry levelData & AI

    We're looking for a VLA Algorithm Engineer working at the intersection of robotics, simulation, and world models to help advance our embodied AI foundation models. You'll build and optimize robotic simulation environments, develop large-scale synthetic training data pipelines,…

  • Maxinsights · Santa Clara, California, United States

    On-siteFull-timeEngineering

    We are looking for a Systems Software & Middleware Engineer to develop and optimize high-performance software for robotics data collection systems. In this role, you will work across software and hardware interfaces to build reliable device-side data recording systems, develop…

  • Maxinsights · Santa Clara, California, United States

    On-siteFull-timeEngineering

    We are looking for a Research Engineer to build simulation environments, training workflows, and evaluation systems for embodied AI and robotics.