UC Berkeley (LMSYS)
La institución académica detrás de vLLM y la arena de modelos
Estados Unidos Institución académica Código abierto
El texto completo se presenta en inglés; el título y el resumen están traducidos.
QUÉ ES
UC Berkeley is a public research university whose LMSYS and related teams have long worked on open models and inference systems. It led the development of the high-throughput inference engine vLLM and runs a model arena where models compete pairwise and users vote.
Por qué es importante
Through vLLM’s PagedAttention it raised the inference throughput of open models, and through the model arena it provided public evaluation independent of vendor leaderboards — both widely adopted.
Hitos clave
- 1868
Founded
- 2023
Released the high-throughput inference engine vLLM