How to log vllm debug output to a file

Just a couple of environment variables and arguments, simply do the following:

export VLLM_LOGGING_LEVEL=DEBUG
export VLLM_DEBUG_LOG_API_SERVER_RESPONSE=TRUE

vllm serve \
--enable-log-requests \
--enable-log-outputs 2>&1 | tee vllm_server.log

That’s it, Enjoy!

Source:

  • Gemini!
Unknown's avatar

About Ahmed Tawfik

Cybersecurity Professional, Systems Engineer, OSS & Linux Geek
This entry was posted in Linux and tagged , . Bookmark the permalink.

Leave a comment