Azure
You can connect to models deployed in the Azure OpenAI Service easily and securely using Promptscape.
You Will Need
-
An Azure OpenAI Service instance, in a subscription you own or have access to
-
Key Reader access to that Azure OpenAI Service instance
-
A model deployed in your AI Service in Azure.
-
These details collected:
name description endpoint The endpoint of your Azure OpenAI Service api key the key you'll use to authenticate, found on the 'Keys and Endpoint' panel of the Azure blade deployment name your Azure OpenAI model's deployment name, most easily found in the AI Foundry
Add the Azure Model
-
On the instance blade for your AI Service, locate the "Keys and Endpoint" section, and make note of your endpoint and key
-
Open the Azure AI Foundry from the Overview pane of the instance blade, and locate your deployment under 'deployments'. Note the deployment name. Your deployment name is not the model name. It is the custom name you chose when you deployed that model. For example, if you deployed a gpt-4-turbo model, you might call it 'my-turbo-model'. This is the deployment name.
-
Back in Visual Studio, run the command
Promptscape: Create a new Model
. The first prompt will ask you to select a provider - choose Azure. -
Next, you'll be asked for the deployment name you collected previously. Provide it, and press enter.
-
Provide the Azure OpenAI Service endpoint, as prompted
-
Next, you'll be asked to provide your API key.
warningOn Microsoft's recommendation, do not use a production Azure OpenAI Instance with key-based authentication, as a rule.
-
Finally, give a memorable and descriptive nickname for your model. You'll use this value to refer to the model when selecting it for use or deletion in Promptscape, so pick a good one!
Locate & Activate the model
Once you have added the model, you will be able to find it in the Explorer, under 'Available Models'.
NOTE: In this picture, the azure model is activated ('Current'). This is not set by default - but you can just click on the model that you want to activate.