Nvidia

Official website https://www.nvidia.com/en-us/ai/

Top Open Foundation Models

The leading open models built by the community, optimized and accelerated by NVIDIA's enterprise-ready inference runtime

Connect your Nvidia account

• Create an account in Nvidia
• Select any model and then click on Get API Key

• Open VSCode and then open the CodeGPT tab
• Choose Nvidia as Provider
• Click on Connect or Set connection
• Paste your Nvidia API Key here, and click on Connect

Remove Key

If you want to remove your API Key from CodeGPT, click on Disconnect from Nvidia

Nvidia models available in CodeGPT

• meta/llama3-70b
• meta/llama3-8b
• nv-mistralai/mistral-nemo-12b-instruct
• meta/llama-3.1-8b-instruct
• meta/llama3-70b-instruct
• meta/llama3-8b-instruct
• ibm/granite-34b-code-instruct
• microsoft/phi-3-mini-128k-instruct
• nv-mistralai/mistral-nemo-12b-instruct
• mistralai/codestral-22b-instruct-v0.1
• mistralai/mixtral-8x22b-v0.1
• mistralai/mistral-large
• mistralai/mistral-7b-instruct-V0.2
• google/gemma-2-2b-it
• google/gemma-2-9b-it
• google/gemma-2-27b-it
• google/gemma-7b
• google/gemma-2b
• google/codegemma-7b
• google/recurrentgemma-2b
• meta/codellama-70b
• meta/llama2-70b

API Errors

If you are getting API errors, check the following link: Nvidia Documentation