Open
Description
Test name: TestQuerierWithBlocksStorageRunningInSingleBinaryMode
Test case: blocks_sharding_enabled,_redis_index_cache,_bucket_index_enabled,thanosEngine=true
Logs for test failure:
=== RUN TestQuerierWithBlocksStorageRunningInSingleBinaryMode/blocks_sharding_enabled,_redis_index_cache,_bucket_index_enabled,thanosEngine=true
00:32:01 Starting consul
00:32:01 consul: ==> Starting Consul agent...
00:32:01 consul: Version: '1.8.4'
00:32:01 consul: Node ID: 'e92963f7-2fa8-a279-1e6a-f3d655df9d51'
00:32:01 consul: Node name: 'consul'
00:32:01 consul: Datacenter: 'dc1' (Segment: '<all>')
00:32:01 consul: Server: true (Bootstrap: false)
00:32:01 consul: Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, gRPC: 8502, DNS: 8600)
00:32:01 consul: Cluster Addr: 127.0.0.1 (LAN: 8301, WAN: 8302)
00:32:01 consul: Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false, Auto-Encrypt-TLS: false
00:32:01 consul: ==> Log data will now stream in as it occurs:
00:32:01 consul: ==> Consul agent running!
00:32:02 Ports for container: e2e-cortex-test-consul Mapping: map[8500:33475]
00:32:02 Starting minio-9000
00:32:02 Ports for container: e2e-cortex-test-minio-9000 Mapping: map[9000:33476]
00:32:02 Starting memcached
00:32:03 Ports for container: e2e-cortex-test-memcached Mapping: map[11211:33477]
00:32:03 Starting redis
00:32:03 redis: 1:C 06 Jun 2025 00:32:03.441 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
00:32:03 redis: 1:C 06 Jun 2025 00:32:03.441 # Redis version=7.0.4, bits=64, commit=00000000, modified=0, pid=1, just started
00:32:03 redis: 1:C 06 Jun 2025 00:32:03.441 # Configuration loaded
00:32:03 redis: 1:M 06 Jun 2025 00:32:03.441 * monotonic clock: POSIX clock_gettime
00:32:03 redis: 1:M 06 Jun 2025 00:32:03.441 * Running mode=standalone, port=6379.
00:32:03 redis: 1:M 06 Jun 2025 00:32:03.441 # Server initialized
00:32:03 redis: 1:M 06 Jun 2025 00:32:03.442 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
00:32:03 redis: 1:M 06 Jun 2025 00:32:03.442 * Ready to accept connections
00:32:03 Ports for container: e2e-cortex-test-redis Mapping: map[6379:33478]
00:32:04 Starting cortex-1
00:32:04 cortex-1: 2025/06/06 00:32:04 maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined
00:32:04 cortex-1: ts=2025-06-06T00:32:04.435326826Z caller=modules.go:370 level=warn msg="Worker address is empty in single binary mode. Attempting automatic worker configuration. If queries are unresponsive consider configuring the worker explicitly." address=127.0.0.1:9095
00:32:04 Ports for container: e2e-cortex-test-cortex-1 Mapping: map[80:33479 9095:33480]
00:32:04 Starting cortex-2
00:32:05 cortex-2: 2025/06/06 00:32:05 maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined
00:32:05 cortex-2: ts=2025-06-06T00:32:05.041893954Z caller=modules.go:370 level=warn msg="Worker address is empty in single binary mode. Attempting automatic worker configuration. If queries are unresponsive consider configuring the worker explicitly." address=127.0.0.1:9095
00:32:05 Ports for container: e2e-cortex-test-cortex-2 Mapping: map[80:33481 9095:33482]
00:32:10 Starting compactor
00:32:10 compactor: 2025/06/06 00:32:10 maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined
00:32:11 Ports for container: e2e-cortex-test-compactor Mapping: map[80:33483 9095:33484]
querier_test.go:533:
Error Trace: /home/runner/work/cortex/cortex/integration/querier_test.go:533
Error: Received unexpected error:
unable to find metrics [thanos_store_index_cache_requests_total] with expected values. Last error: <nil>. Last values: [31]
Test: TestQuerierWithBlocksStorageRunningInSingleBinaryMode/blocks_sharding_enabled,_redis_index_cache,_bucket_index_enabled,thanosEngine=true
Line of test failure:https://github.com/cortexproject/cortex/blame/dd5a7765edf1f1fd12e24429d8136f38ab88359a/integration/querier_test.go#L533
Attaching build logs for investigation:
0_test-no-race.txt
1_test.txt
2_CodeQL.txt
3_lint.txt
4_build.txt
5_integration-configs-db.txt
6_integration (requires_docker).txt
7_integration (integration_alertmanager).txt
8_integration (integration_backward_compatibility).txt
9_integration (integration_memberlist).txt
10_integration (integration_querier).txt
11_integration (integration_ruler).txt
12_integration (integration_query_fuzz).txt