LLM

An LLM connection gives access to a model provider. It can be used with the operators of the Prompt Engineering extension or in Prompt Studio.

Create a connection

Configure the API key for each LLM provider you wish to use. Leave the API key fields blank if you don't wish to use it with Prompt Studio.

Be aware: There’s no Test Connection for LLM connections.

Optionally, you can configure AI Cloud LLM Deployments. You’ll need to setup the Deployment ID and key in the connection to make this work.