Machine Learning - Model Serving Job at Alexander Chapman, Fremont, CA

ZXFrMW1RanlhMUQwTVVrR2pLTXZ3RGhMN2c9PQ==
  • Alexander Chapman
  • Fremont, CA

Job Description

We are working with a company building intuitive, voice-first AI systems that blend natural interaction with powerful model performance. Founded by leaders from Meta, Oculus, and Google, they’re creating a new class of consumer devices powered by speech, vision, and LLMs.

The Role

You’ll help optimize and scale the inference stack, working across model serving, performance tuning, and deployment to support real-time, multimodal AI.

What You’ll Do

  • Improve serving systems for LLMs, speech, and vision models.
  • Optimize throughput, latency, and cost using advanced techniques like batching, caching, and kernel tuning.
  • Extend frameworks like VLLM or SGLang to push the limits of performance.
  • Collaborate with training teams to deploy faster, lighter models.
  • Experiment with compilers and hardware backends to boost efficiency.

What We’re Looking For

  • Strong experience with PyTorch or similar ML frameworks.
  • Deep knowledge of model serving and systems performance.
  • Skilled in low-level debugging, bottleneck analysis, and server optimization.
  • Familiar with VLLM, Ray, or deploying inference workloads at scale.
  • Comfortable owning complex infrastructure projects end to end.
  • Background in computer science or related field from a top-tier university (e.g. Stanford, MIT, Ivy League).
  • Experience at a top tech company (e.g. FAANG) or a successful, high-growth startup.

They’re looking for curious, impact-driven engineers ready to push what’s possible with real-time AI.

Job Tags

Similar Jobs

Museum of Science and Industry (MOSI)

Outreach Instructor: Part-Time (Year-Round) Job at Museum of Science and Industry (MOSI)

 ...Job Description Job Description JOB TITLE: Outreach Instructor: Part-Time (Year Round) EMPLOYER: Museum of Science and Industry DEPARTMENT: Education REPORTS TO: Manager of Group & Outreach Programs SCHEDULE: minimum of 3 weekdays required, Flexible... 

CEC Entertainment, LLC

Kid Check Attendant - Cast Member Job at CEC Entertainment, LLC

 ...squatting during shifts. The work environment includes flashing and flickering lights, moving mechanical parts, and loud noises. Candidates must be at least 15 years old, available for various shifts, have excellent customer service skills, and an energetic and... 

SP Associates

1379-Textile Shift Supervisor (2nd/3rd Shift) Job at SP Associates

 ...Job Title: Textiles Shift Supervisor Job Summary: The Textile Shift Supervisor is responsible for overseeing the daily operations of the yarn spinning process, including machine operation, employee management, quality control, safety, and productivity during the... 

PediaStaff

25-26 Elementary Special Education Resource Specialist Teacher- RSP - JO-2506-36567 Job at PediaStaff

 ...requested Collaborate and provide support to other SPED teachers/specialists as well as GE staff. Manage, train, and support assigned paraeducator Be an integral part of a team of passionate educators and professionals who share a vision and purpose to guarantee... 

City of New York

Environmental Specialist Job at City of New York

Job Description The NYC Department of Environmental Protection (DEP) enriches the environment and protects public health for all New Yorkers...  ...ensures BEDC's compliance with Federal, State, and local EHS laws and regulations. The goal is to run the safest, most...