Skip to content

Integration proposal: Noveum MCP tools for AI evaluation workflows #2263

Description

@imshashank

Noveum operates a hosted MCP server at https://noveum.ai/api/mcp. I would like to contribute a catalog page showing how an ADK agent can use Noveum tools to inspect traces and evaluation results, prepare datasets, and run evaluations when explicitly requested.

Proposed scope:

  • A page under docs/integrations/noveum.md, tagged mcp.
  • A Python example using McpToolset and StreamableHTTPConnectionParams, with the Bearer API key read from an environment variable.
  • A small tool allowlist for the example, plus documentation of OAuth for interactive clients and organization-scoped access.
  • Prerequisites, verified tool names, public setup links, and the Noveum logo.

This would be an MCP tool integration. It would not claim to automatically instrument ADK runs or provide a generic OpenTelemetry exporter; Noveum does not currently ship a dedicated ADK tracing integration.

Verification so far: Smithery completed an authenticated connection and discovered server noveum v1.0.0, 299 tools, 20 prompts, and 16 resources on 24 September 2026. The endpoint and OAuth discovery documents are live. An ADK-specific end-to-end example still needs to be tested before a documentation PR is ready.

I work on Noveum. This proposal was prepared with AI assistance. I read the contribution guide and am opening the issue before preparing the new documentation. Would this focused MCP integration page fit the catalog?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions