Vincent Zhong

I work on GPU inference and study Computer Engineering at the University of Waterloo.

Experience

Liquid AI — ML Engineer Intern, GPU Inference

May–Aug 2026

Brought Liquid's new hybrid models up in SGLang, vLLM, and llama.cpp, then made them fast to serve. Built a custom low-latency production stack for a semantic-ID use case, from kernels to serving.

SGLang — Open-source Contributor

2025–present

New model support and serving speed: speculative decoding, fused kernels, prefix caching for hybrid models, and the correctness bugs found on the way.

Shopify — ML Engineer Intern, Search

Sep–Dec 2025

Used LLMs to correct typos and rewrite queries for Shop.app search. The best version raised search relevance by 2% in A/B tests.

Education