Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Support for Model Context Protocol (MCP) #2662

Open
nirga opened this issue Feb 18, 2025 · 1 comment
Open

Feature Request: Support for Model Context Protocol (MCP) #2662

nirga opened this issue Feb 18, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@nirga
Copy link
Member

nirga commented Feb 18, 2025

Summary
Add support for the Model Context Protocol (MCP) in openllmetry to enhance compatibility with standardized model context tracking and improve observability for generative AI workflows.

Background
MCP provides a standardized way to define and propagate contextual metadata across AI/ML inference workflows. Integrating MCP with openllmetry can enable better context-aware logging, tracing, and performance analysis.

Proposed Solution
Implement MCP-compatible context propagation in openllmetry, ensuring seamless integration with OpenTelemetry-based tracing.
Map existing openllmetry context attributes to MCP's schema where applicable.
Provide utilities or middleware to facilitate MCP adoption for users of openllmetry.
Ensure compatibility with frameworks like LangChain, LlamaIndex, and other AI model orchestration tools.

Open Questions
What is the best way to structure MCP integration within openllmetry?
Should we provide automatic instrumentation for MCP, or require explicit user adoption?
Are there any existing MCP-compatible libraries we can leverage?

Next Steps
Investigate MCP’s data model and how it aligns with openllmetry.
Design an integration approach (manual vs. automatic context propagation).
Implement a prototype and test with supported AI model frameworks.
Gather feedback from users and iterate.

@dosubot dosubot bot added the enhancement New feature or request label Feb 18, 2025
@gyliu513
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants