Describe the bug
The conformance testing documentation shows how to start adk web with RecordingsPlugin to create a baseline, but does not explain that replay testing requires restarting the server with ReplayPlugin.
Following the documented steps alone can leave replay recordings unloaded.
Replay verification failed: AttributeError: 'NoneType' object has no attribute 'recordings'
To Reproduce
- Follow the documentation to create a baseline using
RecordingsPlugin and adk conformance record.
- Continue to the “Run conformance tests” section and run
adk conformance test without changing the web server plugin.
- Observe that replay cannot load the recordings.
Expected behavior
The documentation should instruct users to restart adk web with --extra_plugins=google.adk.cli.plugins.replay_plugin.ReplayPlugin before running replay tests, and show the matching adk conformance test command.
Screenshots
N/A
Versions
- OS: macOS
- ADK version: 2.9.2
- Python version: 3.13.12
Additional context
A walkthrough with the missing step is available in Japanese.
Describe the bug
The conformance testing documentation shows how to start
adk webwithRecordingsPluginto create a baseline, but does not explain that replay testing requires restarting the server withReplayPlugin.Following the documented steps alone can leave replay recordings unloaded.
To Reproduce
RecordingsPluginandadk conformance record.adk conformance testwithout changing the web server plugin.Expected behavior
The documentation should instruct users to restart
adk webwith--extra_plugins=google.adk.cli.plugins.replay_plugin.ReplayPluginbefore running replay tests, and show the matchingadk conformance testcommand.Screenshots
N/A
Versions
Additional context
A walkthrough with the missing step is available in Japanese.