Liquid AI — ML Engineer Intern, GPU Inference
Brought Liquid's new hybrid models up in SGLang, vLLM, and llama.cpp, then made them fast to serve. Built a custom low-latency production stack for a semantic-ID use case, from kernels to serving.
Brought Liquid's new hybrid models up in SGLang, vLLM, and llama.cpp, then made them fast to serve. Built a custom low-latency production stack for a semantic-ID use case, from kernels to serving.
New model support and serving speed: speculative decoding, fused kernels, prefix caching for hybrid models, and the correctness bugs found on the way.
Used LLMs to correct typos and rewrite queries for Shop.app search. The best version raised search relevance by 2% in A/B tests.