Tag Archives: vllm

How to log vllm debug output to a file

Just a couple of environment variables and arguments, simply do the following: export VLLM_LOGGING_LEVEL=DEBUGexport VLLM_DEBUG_LOG_API_SERVER_RESPONSE=TRUE vllm serve \–enable-log-requests \–enable-log-outputs 2>&1 | tee vllm_server.log That’s it, Enjoy! Source:

Posted in Linux | Tagged , | Leave a comment