APIConnectionError: Connection error..

[mi112]

I am trying to use Fara-7B hosted in Azure Foundry.

I have also set the credentials in azure_foundry_config.json
{
"model": "Fara-7B",
"base_url": "https://myendpoint.ml.azure.com/",
"api_key": "myapikey"
}

I am using following command:
fara-cli --task "how many pages does wikipedia have" --endpoint_config endpoint_configs/azure_foundry_config.json --headful

I keep receiving following error:
Retrying fara.fara_agent.FaraAgent._make_model_call in 5.0 seconds as it raised APIConnectionError: Connection error..

[mehuljariwala]

Hello @mi112

Few things to check:

1. Endpoint URL format - Azure Foundry endpoints usually need /v1 at the end:

   "base_url": "https://myendpoint.inference.ml.azure.com/v1"

2. Verify the endpoint is running - In Azure AI Studio, check if the deployment status shows "Succeeded" and the endpoint is actually online.

3. Test the endpoint directly with curl:

   curl -X POST "https://myendpoint.inference.ml.azure.com/v1/chat/completions" \
     -H "Authorization: Bearer myapikey" \
     -H "Content-Type: application/json" \
     -d '{"model": "Fara-7B", "messages": [{"role": "user", "content": "test"}]}'

If curl also fails, the issue is with the Azure deployment itself, not fara.