Introduction to Local AI
Running AI locally is seen as the private alternative to ChatGPT and similar services, offering users more control over their data. For plain chat, this holds up, but certain AI apps like Ollama and LM Studio connect to the internet on their own, posing potential privacy risks. A notable example is Cohere’s Qwen test, which demonstrated how an AI agent with shell access can send data out. This article will guide you through the process of turning off the online features of both Ollama and LM Studio and cutting agents off from the internet on Windows and Mac.
Understanding the Risks
The convenience of AI-powered apps comes with a price, as evidenced by the Samsung Galaxy S25‘s AI capabilities and the Apple Watch Series 10’s integration with AI-driven health features. While these features are useful, they also increase the attack surface. Ensuring your local AI setup remains offline is crucial for maintaining privacy, similar to keeping your iPad Air M2’s operating system up to date.
Disabling Online Features in Ollama
To disable online features in Ollama on Windows, navigate to the app’s settings, typically found in the top right corner, and select ‘Preferences’. Then, scroll down to the ‘Network’ section and toggle off ‘Allow internet access’. On Mac, the process is similar: open Ollama, go to ‘Ollama’ > ‘Preferences’, and under ‘Network’, uncheck ‘Connect to internet’. This simple step significantly enhances your privacy, much like using a VPN on your Apple iPhone 14 Pro.
Securing LM Studio
For LM Studio, the process involves a bit more technical know-how. On both Windows and Mac, you’ll need to access the app’s configuration file. This can usually be found in the app’s installation directory. Open the file in a text editor like Notepad on Windows or TextEdit on Mac, and look for the line that says ‘online_features=true’. Change this to ‘online_features=false’ and save the file. This will prevent LM Studio from connecting to the internet, ensuring your data stays local, much like storing sensitive information on an encrypted external hard drive connected to your Dell XPS 13 laptop.
Conclusion
In conclusion, while local AI offers a private chatting experience, apps like Ollama and LM Studio require extra steps to ensure they remain offline. By following the steps outlined above, you can secure your AI setup and protect your privacy, whether you’re using a Microsoft Surface Laptop or an Apple MacBook Air. Remember, privacy in the digital age is about being proactive, whether it’s securing your local AI or using privacy-focused browsers like Brave on your smartphone.