Groq

Official website https://groq.com/

Groq provides a simple way to leverage models running on LPU (Language Processing Unit), enabling us to achieve speedy inference response times.

Connect your Groq account

• Create an account in https://groq.com/
• Go to your dashboard
• Go to VSCode and choose Groq as Provider
• Click on Connect or Set connection
• Paste API Key here, and click on Connect:

Remove Key

If you want to remove your API Key from CodeGPT, click on the provider box and click on Disconnect.

Groq models available in CodeGPT

• llama-3.2-90b-text-preview
• llama-3.2-11b-text-preview
• llama-3.2-3b-preview
• llama-3.2-1b-preview
• llama-3.1-405b-reasoning
• llama-3.1-70b-versatile
• llama-3.1-8b-instant
• llama3-70b-8192
• llama3-8b-8192
• mixtral-8x7b-32768
• gemma-7b-it
• gemma2-9b-it