Author Archives: Ahmed Tawfik

Unknown's avatar

About Ahmed Tawfik

Cybersecurity Professional, Systems Engineer, OSS & Linux Geek

How to log vllm debug output to a file

Just a couple of environment variables and arguments, simply do the following: export VLLM_LOGGING_LEVEL=DEBUGexport VLLM_DEBUG_LOG_API_SERVER_RESPONSE=TRUE vllm serve \–enable-log-requests \–enable-log-outputs 2>&1 | tee vllm_server.log That’s it, Enjoy! Source:

Posted in Linux | Tagged , | Leave a comment

How to install Headless LM Studio on Linux

Simply run curl -fsSL https://lmstudio.ai/install.sh | bash After you install, don’t forget to source your .bashrc file via source .bashrc so that you can run the lms command. To bring it up, run lms daemon up After it’s up, you … Continue reading

Posted in Linux | Tagged , , , , | Leave a comment

How to Configure Tavily MCP Server in LM Studio

I needed to add a web search functionality to my models in LM Studio, so I simply had to add the Tavily MCP Server configuration to LM studio, along with my API key of course. You simply click on Edit … Continue reading

Posted in Linux | Tagged , , , | Leave a comment

Count JSON objects in a file using jq

Simply run: For example: Will return 2! That’s it, Enjoy! Sources:

Posted in Linux | Tagged , | Leave a comment

Enable debug mode for Ollama on Linux/mac

Simply run it as follows: Note: You might want to export another variable to show the ollama serve command where the models are saved in case you receive a 404 about model not available, this happened to me for some … Continue reading

Posted in Ollama | Tagged , | Leave a comment