Skip to content

roachtest: backup/nodeShutdown/worker/n4cpu4 failed #156337

@cockroach-teamcity

Description

@cockroach-teamcity

roachtest.backup/nodeShutdown/worker/n4cpu4 failed with artifacts on release-25.3 @ 692054f785c04833771dcbf228d480c2ef9c3bc5:

(assertions.go:369).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/jobs_util.go:49
	            				pkg/cmd/roachtest/tests/backup.go:228
	            				pkg/cmd/roachtest/test_runner.go:1389
	            				src/runtime/asm_amd64.s:1700
	Error:      	Received unexpected error:
	            	monitor failure: unexpectedly found job 1119211097293127682 in state failed
	            	(1) attached stack trace
	            	  -- stack trace:
	            	  | main.(*monitorImpl).WaitE
	            	  | 	pkg/cmd/roachtest/monitor.go:229
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.executeNodeShutdown
	            	  | 	pkg/cmd/roachtest/tests/jobs_util.go:158
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.jobSurvivesNodeShutdown
	            	  | 	pkg/cmd/roachtest/tests/jobs_util.go:49
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerBackupNodeShutdown.func2
	            	  | 	pkg/cmd/roachtest/tests/backup.go:228
	            	  | main.(*testRunner).runTest.func2
	            	  | 	pkg/cmd/roachtest/test_runner.go:1389
	            	Wraps: (2) monitor failure
	            	Wraps: (3) attached stack trace
	            	  -- stack trace:
	            	  | main.(*monitorImpl).wait
	            	  | 	pkg/cmd/roachtest/monitor.go:328
	            	  | main.(*monitorImpl).WaitE
	            	  | 	pkg/cmd/roachtest/monitor.go:229
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.executeNodeShutdown
	            	  | 	pkg/cmd/roachtest/tests/jobs_util.go:158
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.jobSurvivesNodeShutdown
	            	  | 	pkg/cmd/roachtest/tests/jobs_util.go:49
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerBackupNodeShutdown.func2
	            	  | 	pkg/cmd/roachtest/tests/backup.go:228
	            	  | [...repeated from below...]
	            	Wraps: (4) unexpectedly found job 1119211097293127682 in state failed
	            	    └─ Wraps: (5) attached stack trace
	            	  -- stack trace:
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.executeNodeShutdown.func1
	            	  | 	pkg/cmd/roachtest/tests/jobs_util.go:130
	            	  | main.(*monitorImpl).Go.func1
	            	  | 	pkg/cmd/roachtest/monitor.go:207
	            	  | golang.org/x/sync/errgroup.(*Group).Go.func1
	            	  | 	external/org_golang_x_sync/errgroup/errgroup.go:78
	            	  | runtime.goexit
	            	  | 	src/runtime/asm_amd64.s:1700
	            	      └─ Wraps: (6) unexpectedly found job 1119211097293127682 in state failed
	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *join.joinError (5) *withstack.withStack (6) *errutil.leafError
	Test:       	backup/nodeShutdown/worker/n4cpu4
(require.go:1357).NoError: FailNow called
test artifacts and logs in: /artifacts/backup/nodeShutdown/worker/n4cpu4/cpu_arch=s390x/run_1

Parameters:

  • arch=s390x
  • cloud=ibm
  • coverageBuild=false
  • cpu=4
  • encrypted=true
  • metamorphicLeases=default
  • metamorphicWriteBuffering=true
  • runtimeAssertionsBuild=false
  • ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for ibm clusters

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-55946

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions