Skip to main content

Cerebras

Official website: https://cerebras.ai/

Cerebras is a cutting-edge computing platform for large-scale artificial intelligence model training and inference. This guide provides a comprehensive overview of Cerebras, including detailed information on core concepts, workflows, features, and the Cerebras PyTorch API.

Key Features​

  • Cerebras Model Zoo with pre-configured Large Language Models (LLM)
  • Support for Computer Vision (CV) models
  • Compatibility with multimodal models like LLaVA
  • Ability to use custom PyTorch models and datasets

The Cerebras Wafer-Scale Cluster is meticulously engineered to enable neural network training with remarkably efficient linear scaling across millions of cores without the complexities of traditional distributed computing.

How to Connect​

  • Once you have the API Key, go to the VSCode extension
  • Select Cerebras as the provider with the desired model
  • Paste the API Key
  • Click on "Connect"

Remove Key

If you want to remove your API Key from CodeGPT, click on the provider box and "Disconnect".

Cerebras Models Available in Code GPT​

  • Llama3.1-70b
  • Llama3.1-8b

API Errors​

If you are experiencing API errors, please refer to the following documentation: Cerebras Documentation

Important Note

This provider is only available in version 3.5.73 of the CodeGPT extension for VSCode and later. Make sure you have the extension updated.