https://blog.cue4net.com/tags/nvidia-container-toolkit/ Recent content in Nvidia Container Toolkit on Public Notes Hugo en-us Sun, 15 Sep 2024 05:06:09 +0200 https://blog.cue4net.com/posts/ollama-as-network-service/ Sun, 15 Sep 2024 05:06:09 +0200 https://blog.cue4net.com/posts/ollama-as-network-service/ Enabling Seamless Integration with Ollama as a Network Service Developed by the same team behind the innovative llama models, Ollama offers a unique advantage: compatibility with LocalAI API in its later versions. This means that Ollama can be seamlessly integrated into various LLM (Large Language Model) integration applications, such as Nextcloud Assistant or the Continue plugin for VSCode and IntelliJ. For my own installation process, I opted for a Docker-based approach.