Machine Learning Engineer Job at Realm, San Jose, CA

S29iMUd1elJTUjN0UDgwbkxYb0NzUlJzdFE9PQ==
  • Realm
  • San Jose, CA

Job Description

SENIOR ML ENGINEER | BUILD GLOBAL AI NETWORKS | HYBRID SF | $300k + EQUITY

My client is building a unique, globally distributed system that harnesses spare computational resources from around the world to run cutting-edge models like Llama and Mistral. We’re searching for an ML engineer excited about solving complex engineering challenges within a small, high-impact team based in San Francisco.

If you’re passionate about working on advanced distributed systems, machine learning, and resource optimization, this could be a great opportunity. The team consists of experienced engineers who thrive in a dynamic, fast-paced environment, with a focus on creativity, collaboration, and hands-on coding.

We are looking for Senior-Staff level engineers or ex-founders, who are high agency, high throughput, very technical people who WANT to be in person working on interesting problems.

Salary : $200-300k + equity

Interview process : 4 stages

Location : SF (hybrid 3 days a week)

What we're looking for:

  • Proficient in Typescript, Python, and at least one of Go, Rust, or C++
  • Deep understanding of distributed systems and their underlying principles
  • Hands-on experience with container orchestration and scheduling tools, such as Kubernetes or Nomad
  • Experience with large language model inference engines (e.g., vLLM, TensorRT-LLM)
  • Familiarity with AI development tools (e.g., ChatGPT, Claude, Cursor) to enhance productivity and workflow
  • Knowledge of GPU programming and optimization techniques (CUDA experience is advantageous)

This client can support H1B visa transfers for candidates who require it.

Tags:

Python, Typescript, Rust, Go, C++, ML, Machine Learning, AI, GenAI, LLM, GPU, Inference

Job Tags

H1b, 3 days per week,

Similar Jobs