All Stories

  1. Eloquent: A More Robust Transmission Scheme for LLM Token Streaming

    Article • August 2024, ACM (Association for Computing Machinery)

    Hanchen Li

  2. CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

    Article • August 2024, ACM (Association for Computing Machinery)

    Ganesh Ananthanarayanan, Hanchen Li

  3. Optimizing Real-Time Video Experience with Data Scalable Codec

    Article • September 2023, ACM (Association for Computing Machinery)

    Hanchen Li