Tin Long Leung

MPhil student researching human-computer interaction for data annotation.

Ecosystems: Python, PyTorch, Llama, Cuda

Projects

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python - Released: 09 Feb 2023 - 28,039