Skip to content

vllm.grpc

vLLM gRPC protocol definitions.

This module contains the protocol buffer definitions for vLLM's gRPC API. The protobuf files are compiled into Python code using grpcio-tools.

Modules:

Name Description
compile_protos

Compile vLLM protobuf definitions into Python code.

__all__ module-attribute 

__all__ = ['vllm_engine_pb2', 'vllm_engine_pb2_grpc']