Bug: The latest library of SemanticKernel does not support Azure o1 series models

[2023pfm]

The latest library of SemanticKernel does not support Azure o1 series models.
Reason for error: Unsupported parameter: 'max_tokens' is not supported with this model Use 'max_completion_tokens' instead.
Additionally, calling the tool may also result in an error stating that the tool is not supported.
What should I do now, thank you.

[RogerBarreto]

@2023pfm, can you provide more context for this issue?

What was the version used, some code for reproduction?

Currently we are using the new property from OpenAI SDK which already supports the new max_completion_tokens

semantic-kernel/dotnet/src/Connectors/Connectors.AzureOpenAI/Core/AzureClientCore.ChatCompletion.cs

Line 41 in b6675e7

MaxOutputTokenCount = executionSettings.MaxTokens,

Open SDK using the new name behind the scenes as you can see in here:
https://github.com/openai/openai-dotnet/blob/c49dd7065215bc0d094c7f79ccd634a38f0d7b66/src/Custom/Chat/ChatCompletionOptions.cs#L156
There you can also see their comments on the deprecated maxtokens.

So everything points me that you may be using an older release of our packages and that problem should not happen when using SK 1.22 moving forward.

Let me know if you still have problems with the latest 1.22 and more details about your error and problem.

[2023pfm]

How to implement MaxOutputTokenCount in the Azure OpenAiPomptExecutionSettings class.

[fwaris]

running into the same issue on Azure.

MaxTokens is not accepted for o1 models.

o1 supports a new parameter instead called 'max_completion_tokens'

[Vifill]

I have the same issue. Using o1, Azure and AzureOpenAIPromptExecutionSettings on version 1.31.

Note that it works if I don't set the MaxTokens in the AzureOpenAIPromptExecutionSettings, but once I try to set the MaxTokens, it fails.

[markwallace-microsoft]

@RogerBarreto reopening to address the last two comments

[RogerBarreto]

This issue is a duplicated from the issue below (since this one has less data I'm closing this) consider the following issue:

• .Net: Bug: SK can't call AzureOpenAI o1/o3-mini models #10201

TLDR: Azure SDK currently don't support o1 models and fails with the above message when attempting to providing max tokens. Other limitations were also identified like using the latest API preview versions.

I provided a workaround posted here using a custom http handler that may be able to use SK against that model.