Google Vertex AI
Official website https://cloud.google.com/
Connect your Vertex credentials
Obtaining your credentials on Google Cloud can be tricky. As of March 28, 2024, here's the process to obtain them:
On Google Cloud
- Navigate to https://cloud.google.com/ and log in with your Gmail account.
- Initiate the Console by selecting the option in the top right corner.
- In the left panel, click on the "Models Garden" tab.
- In the search box at the top, type
Vertex AI
. ChooseVirtual Studio Vertex
. - Ensure you have enabled the Vertex AI API, Dataform API, and Compute Engine API.
- Go to the Dashboard.
- Select "API & Services" from the right-hand menu and click
Credentials
. Click on the email associated with Service Accounts. You'll be directed to the Service Account page. From there, navigate to theKeys
tab and selectAdd Key
. The download should start automatically, and the file should be saved as a .json. - Rename the downloaded file to
credentials
. - For the Custom Link, customize it as needed, ensuring the LOCATION, PROJECT_ID, and MODEL are changed.
https://LOCATION-aiplatform.googleapis.com/v1/projects/PROJECT_ID/locations/LOCATION/publishers/google/models/MODEL:streamGenerateContent
On CodeGPT Extension
- On the VSCode CodeGPT Extension, change the model on the chat.
Pick the
LLMs Cloud model
and selectCohere
asProvider
.Select a model, for example,
llama3-70b-chat-hf
.Paste
API Key
here, and click onConnect
.Paste the link model and Upload the credential.json file.
Use the models available directly. Click outside the options and ask to chat.
Remove or edit Key
To remove your API Key from CodeGPT, click on Change connection settings
button.
API Errors
If you are getting API errors, check the following link: Vertex AI Documentation