Ollama
Official website https://ollama.ai
Opensource project to run, create, and share large language models (LLMs).
Connect Ollama Models
- Download Ollama from the following link: ollama.ai
Download models via the console
- Install Ollama and use the model codellama by running the command
ollama pull codellama - If you want to use mistral or other models, you will need to replace codellama with the desired model. For example:
ollama pull mistral
Download models via CodeGPT UI
- Select Ollama as the
Provider - Select the model
- Click the
Downloadbutton
How to use Ollama
In VSCode and Select Ollama like a
ProviderPlease be aware that Ollama is running locally on your computer.
Choose a model
Remove Key
No need to disconnect, just change the provider.
Ollama Models available in Code GPT
- llama3:70b
- llama3.1:405b
- llama3.1:70b
- llama3:8b
- codestral:latest
- mathstral:latest
- mistral:v0.3
- command-r-plus:latest
- command-r:latest
- codeqwen
- qwen2:72b
- qwen2:7b
- qwen2:1.5b
- qwen2:0.5b
- aya:8b
- aya:35b
- codegemma:latest
- gemma2:2b
- gemma2:9b
- gemma2:27b
- gemma:7b
- gemma:2b
- granite-code:3b
- granite-code:8b
- granite-code:20b
- granite-code:34b
- dbrx:latest
- mistral:latest
- mixtral:latest
- llama2
- codellama:latest
- phi3:mini
- phi3:medium
- phi3:latest
- deepseek-coder-v2
- deepseek-coder:latest
- starcoder2:latest
- dolphincoder:latest
- dolphin-mixtral:latest
- starling-lm:latest
- dolphin-mixtral:latest
- starling-lm:latest
- llama2-uncensored:latest
API Errors
If you are getting API errors check the following link: Ollama Documentation
Ollama Errors
If the Ollama model does not respond in the chat, consider restarting it locally by turning it off and then on again. This action should resolve the issue.
If the Ollama is running but not responding, please manually remove 'Ollama_Host' from the environment variables and let it revert to the default setting.