Senior Machine Learning Engineer, LLM Inference Optimization

Nebius is seeking a Senior Machine Learning Engineer to join their Applied AI team, focusing on optimizing model and endpoint performance. The role involves working on various aspects of model internals, including quantization, compression, and inference engine optimization. Daily tasks will include diagnosing performance issues, comparing configurations, and implementing improvements to enhance latency, throughput, and memory efficiency while maintaining quality. The engineer will collaborate with kernel and platform engineers to address serving challenges and validate optimizations through benchmarks and real-world testing. Candidates should have experience in machine learning and a strong understanding of model optimization techniques. The position is remote, allowing for flexibility in work arrangements. This role is ideal for individuals with a solid background in AI and a passion for solving complex technical problems in a collaborative environment.