Describe the feature
The @aws-cdk/aws-bedrock-agentcore-alpha package has L2 constructs for Runtime, Browser, Code Interpreter, Gateway, and Memory — but not for Evaluations. The L1 resources AWS::BedrockAgentCore::Evaluator and AWS::BedrockAgentCore::OnlineEvaluationConfig exist but have no L2 wrappers.
Requesting L2 constructs for:
Evaluator — custom evaluators (LLM-as-a-Judge and code-based)
OnlineEvaluationConfig — continuous monitoring of agent performance
Use Case
I'm building an AI agent on AgentCore and need to set up continuous quality monitoring using CDK. Currently I have to use the L1 CfnEvaluator and CfnOnlineEvaluationConfig directly, manually constructing IAM roles with the correct permissions, wiring up CloudWatch Logs data sources, and handling the mapping between evaluator references and their IDs. An L2 construct would provide sensible defaults (auto-created execution role with scoped permissions, built-in evaluator references, inference profile detection for model ARNs) and a developer-friendly API consistent with the existing Runtime, Browser, Gateway, and Memory constructs in the package.
Proposed Solution
No response
Other Information
No response
Acknowledgements
AWS CDK Library version (aws-cdk-lib)
2.250.0
AWS CDK CLI version
2.1118.4
Environment details (OS name and version, etc.)
Amazon Linux 2023 (EC2), Node.js 20.20.2, TypeScript 5.5.4, CDK CLI 2.1118.4
Describe the feature
The @aws-cdk/aws-bedrock-agentcore-alpha package has L2 constructs for Runtime, Browser, Code Interpreter, Gateway, and Memory — but not for Evaluations. The L1 resources AWS::BedrockAgentCore::Evaluator and AWS::BedrockAgentCore::OnlineEvaluationConfig exist but have no L2 wrappers.
Requesting L2 constructs for:
Evaluator — custom evaluators (LLM-as-a-Judge and code-based)
OnlineEvaluationConfig — continuous monitoring of agent performance
Use Case
I'm building an AI agent on AgentCore and need to set up continuous quality monitoring using CDK. Currently I have to use the L1 CfnEvaluator and CfnOnlineEvaluationConfig directly, manually constructing IAM roles with the correct permissions, wiring up CloudWatch Logs data sources, and handling the mapping between evaluator references and their IDs. An L2 construct would provide sensible defaults (auto-created execution role with scoped permissions, built-in evaluator references, inference profile detection for model ARNs) and a developer-friendly API consistent with the existing Runtime, Browser, Gateway, and Memory constructs in the package.
Proposed Solution
No response
Other Information
No response
Acknowledgements
AWS CDK Library version (aws-cdk-lib)
2.250.0
AWS CDK CLI version
2.1118.4
Environment details (OS name and version, etc.)
Amazon Linux 2023 (EC2), Node.js 20.20.2, TypeScript 5.5.4, CDK CLI 2.1118.4