Project vLLM Open-source model inference and serving software for running a model service on managed hardware.