-
Notifications
You must be signed in to change notification settings - Fork 546
Audit protocol types #892
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Audit protocol types #892
Conversation
| { | ||
| Messages = samplingMessages, | ||
| MaxTokens = options?.MaxOutputTokens, | ||
| MaxTokens = options?.MaxOutputTokens ?? int.MaxValue, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should determine whether int.MaxValue is actually a reasonable default value for MaxTokens. Previously, we allowed null as a valid value, but the schema indicates that it's required.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's not a reasonable value. LLM apis will fail using maxint.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For comparison, it looks like the MCP Python SDK requires the developer to specify a value for maxTokens. Our APIs aren't exactly set up to do this because the options parameter in the highlighted code can be null, and so can the MaxOutputTokens property.
Maybe we could introduce a DefaultSamplingMaxTokens property on McpServerOptions so that the developer can configure what the value should be whenever it's not explicitly stated in the provided ChatOptions. And we'd choose a reasonable default. Maybe 100 or 1000 or something.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@copilot could you explore and implement a solution like what I described above? Thanks.
| { | ||
| Blob = dataContent.Base64Data.ToString(), | ||
| MimeType = dataContent.MediaType, | ||
| Uri = string.Empty, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was implicitly string.Empty before, but now it's explicit. This PR doesn't introduce a behavioral change here, but we should decide whether the empty string should really be used here, as it's not actually a valid URI. It would also be strange to use dataContent.Uri, because then the data is specified in two places (once in Blob and once in Uri).
| /// </summary> | ||
| [JsonPropertyName("name")] | ||
| public string Name { get; set; } = string.Empty; | ||
| public required string Name { get; set; } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
FWIW introducing required is also considered a breaking change.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yep. And the same is true for other changes made in this PR (e.g., IReadOnlyList<T> -> IList<T>). We'll have to decide which changes are worth their induced breaks.
For context, the presence of |
| /// </summary> | ||
| [JsonPropertyName("messages")] | ||
| public required IReadOnlyList<SamplingMessage> Messages { get; init; } | ||
| public IList<SamplingMessage> Messages { get; set; } = []; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why was this changed back to optional? Presumably not required by the schema?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
My thinking here was that this property is still effectively "required" in that it's not declared as allowing null values. We just no longer require an explicit value on initialization, since a reasonable, non-null default exists ([]).
However, your comment made me realize that removing required actually does make the property "optional" in that we will no longer throw an exception on deserialization if the property is missing from the JSON payload. Maybe this is OK. We also don't appear to be using RespectNullableAnnotations, so the JSON input could still explicitly provide null for this property anyway. So, required alone still isn't enough to enforce that the JSON property has a specified, non-null value.
Curious about your thoughts - do you think it's fine to have a default initial value as a substitute for required?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Or maybe we should consider enabling RespectNullableAnnotations so that we're able to enforce required-ness to a more complete degree?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, I think we absolutely should be turning this on everywhere, but we're currently blocked by the fact that our minimum STJ version is 8 which does not expose this setting. We should consider moving the minimum version to 10 once that goes GA and enable RespectNullableAnnotations (as well as its sibling RespectRequiredConstructorParameters setting).
| { | ||
| Assert.Same(mockServer.Object, server); | ||
| return new ReadResourceResult { Contents = [new TextResourceContents { Text = "hello" }] }; | ||
| return new ReadResourceResult { Contents = [new TextResourceContents { Text = "hello", Uri = string.Empty }] }; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have a potentially naive question directed to the wider audience of this PR. In general, why do we prefer using string.Empty over ""? They both reference the same instance anyway.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't. It's purely style which is chosen.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why don't we go for the shorter and easier to read alternative then? :-)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Happy to change it. Only reason I used string.Empty was because I saw it already being used in other places and wanted to keep things consistent.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
string.Empty has been the dominant convention across our repos AFAICT. It's just that I never stopped to ask why we do it. No need to make that change in this PR I think.
What are our principles around this? I know JsonNode is mutable and JsonElement is not, but why is JsonNode use for params and results and JsonElement or |
Exactly what I'm wondering too 🙂 Maybe we could get an STJ expert to weigh in on this? |
Summary
Audits and standardizes MCP protocol types for consistency.
Fixes #519
Description
There are several inconsistencies across protocol types, including:
initvs.setrequiredvs. default property valuesenumvs.stringJsonNodevs.JsonElementvs.IDictionary<string, JsonElement>vs.IDictionary<string, object>This PR applies the following set of conventions to improve consistency:
Property Mutability
Guideline: Always use
set- noinit-only properties.Rationale:
setorinit, it's easier to standardize onsetbecause doing so is non-breakinginitmeans that if we do want to mutate a property after initialization, we need to clone the its containing object, which can be error-prone and isn't great for perfRequired Properties
Guideline: Use
requiredwhen the spec indicates a property is required, unless a clear, safe default exists.Rationale:
Safe defaults include:
Avoid defaults such as:
"") - this is rarely the expected value for a "required" propertyCollections
Guideline: Prefer
IList<T>/IDictionary<TKey, TValue>overIReadOnlyList<T>/IReadOnlyDictionary<TKey, TValue>.Rationale:
Open Questions
The following inconsistencies remain for further discussion:
enumvs.string: propertiesThe MCP schema defines some properties as unions of string values.
enumoffers strong typingstringis more future-proof (e.g., if new values are added)Existing examples of each:
enum:ContextInclusion,Rolestring:ElicitResult.ActionJSON-like Structures:
The use of
JsonNode,JsonElement,IDictionary<string, JsonElement>, andIDictionary<string, object>varies.Additional Notes