Make Azure AI useable

[smolit]

Hi, has anyone successfully tried to use Azure AI for AI analysis?
I tried it with gpt-4 chat completions model. But with no success.
It would be grate if I could get some hints from you.

Best Regards
Sebastian

[destari]

Any other information you can provide on how you configured things? I don't have Azure AI accounts to try it on, but I could take a look at what config setup you have, plus docs, and maybe figure it out?

[smolit]

Thank you for your fast reply and sorry for my late answer. In the following I will give you more information about my setup and what I have tried to get Azure AI running with gonzon.

In the Azure AI Foundry portal I deployed an Azure AI Foundry project.

In the project I deployed a GPT-4 model and tried to use it.

The GPT-4 model comes with its own endpoint and key.
E.g. https://xxxx-9929-resource.cognitiveservices.azure.com/openai/deployments/gpt-4/chat/completions?api-version=2025-01-01-preview

I the AI Foundry portal there are multiple endpoints for the project and the model. But none of them are working. I get always a http 404 error.

You also get an endpoint in the Azur portal for the deployed Azure Open AI instance. I also tried to use this endpoint and it's key with gonzo and got a http 401 error.

I think this information is a bit superficial, so please let me know what other information you need.

Thanks
Sebastian

[j0nr33v3]

It looks like you need to pass a version to the Azure API based on this https://learn.microsoft.com/en-us/rest/api/azureopenai/models/list?view=rest-azureopenai-2024-10-21&tabs=HTTP

GET {endpoint}/openai/models?api-version=2024-10-21

Looks like OpenAPI doesn't need that...

Thank you to Cris Nevares for digging in here

[smolit]

Thank you for your reply.
I still used the version inside the endpoint address. And I can validate the API key like in your example.
For me, that means my API key is correct and works and my endpoint is also the right one.

But I still get a 401 when I use gonso.

Any other idea here in the community?