vLLM Pooling Serve
Use the serve action to deploy pooling models with vLLM on Kubernetes. Pooling models support tasks such as embedding and reranking.
Use the serve action to deploy pooling models with vLLM on Kubernetes. Pooling models support tasks such as embedding and reranking.