Tag Archives: vllm

Upgrade vLLM (don’t!)

Posted on August 24, 2026 by Ahmed Tawfik

The best way to upgrade vLLM is actually NOT to upgrade it, but to wipe it’s venv and install from scratch, in my opinion and based on my experimentation, just run: deactivate rm -rf .venv uv venv –python 3.12 –seed … Continue reading →

Posted in Linux | Tagged , , , , | Leave a comment

How to log vllm debug output to a file

Posted on May 20, 2026 by Ahmed Tawfik

Just a couple of environment variables and arguments, simply do the following: export VLLM_LOGGING_LEVEL=DEBUGexport VLLM_DEBUG_LOG_API_SERVER_RESPONSE=TRUE vllm serve \–enable-log-requests \–enable-log-outputs 2>&1 | tee vllm_server.log That’s it, Enjoy! Source:

Posted in Linux | Tagged , | Leave a comment