providers
Cerebras
Wafer-scale hardware; the fastest tokens/sec on the market, with a free tier. Small catalog, extreme speed.
| endpoint | https://api.cerebras.ai/v1 |
| env var | CEREBRAS_API_KEY |
| get a key | cloud.cerebras.ai |
Get an API key
- Sign up or log in at cloud.cerebras.ai
- Click 'API Keys' in the left nav
- Click 'Create API Key' and name it
- Copy the key and store it securely
- Export it as CEREBRAS_API_KEY
Free dev tier: 1M tokens/day, no card, ~30 req/min (8k context cap).
Enable
export CEREBRAS_API_KEY=... # shell profile — survives foreveror in the terminal — validates the key live before saving:
/enable cerebrasor pick any locked 🔒 Cerebras model in /models and paste the key inline.
Models
Starter menu (once enabled, /models fetches the provider's full live list):
gpt-oss-120bzai-glm-4.7llama-3.3-70bgemma-4-31b
Switch anytime — /model gpt-oss-120b fuzzy-matches; context carries over.
SDK
from mantis_agent import MantisAgentOptions
options = MantisAgentOptions(
model="gpt-oss-120b",
backend="https://api.cerebras.ai/v1", # key read from $CEREBRAS_API_KEY
)Notes
- Free tier available.
- Catalog is small but every model streams at 1000+ tok/s.