Vllm on Amit Agarwal Linux Blog /tags/vllm/ Recent content in Vllm on Amit Agarwal Linux Blog Hugo -- gohugo.io en Thu, 25 Dec 2025 00:00:00 +0530 Run a Local LLM API Server with vLLM (OpenAI-Compatible, Fast, and Simple) /2025/12/25/2025-12-25-local_vllm/ Thu, 25 Dec 2025 00:00:00 +0530 /2025/12/25/2025-12-25-local_vllm/ Step-by-step: create a uv virtualenv, install vLLM with the right torch backend, and launch <code>vllm serve</code> to get an OpenAI-compatible local API endpoint.