Embedding VC

Member of Technical Staff - Efficient ML

5mo ago
USALead
Embedding VC

Member of Technical Staff - Efficient ML

5mo ago
USALeadgpucudansightslurmk8squantizationpruningdistillation

Machine learning engineer focused on training efficiency, inference optimization, and infrastructure reliability for AI simulations.

Other

  • Introducing Moonlake, AI for creating world simulations.
  • Dataloaders, fusion, activation remat, gradient checkpointing.
  • FSDP/ZeRO/tensor+pipeline parallel; NCCL tuning.
  • Nsight profiling, Triton/CUDA kernels, fused ops.
  • Flash-attention–style speedups, sequence packing, KV-cache tricks.
  • Low-latency serving, continuous batching, speculative decoding.
  • Quantization (GPTQ/AWQ), distillation, pruning.
  • SLURM/K8s multi-node jobs, checkpoint hygiene.
  • Determinism, env pinning, GPU failure handling.
  • We are committed to being an on-site, in-person team currently based in San Mateo