Skip to content

failing zstd-related tests for LLVM 16.0.6 (on RHEL9 @ UGent) #22486

Description

@boegel

While running extensive tests in #20902, there were two failing tests related to zstd for the LLVM 16.0.6 easyconfigs:

Failing tests for LLVM 16.0.6 on RHEL9:

Failed Tests (2):
  LLVM :: MC/ELF/compress-debug-sections-zstd-unavailable.s
  LLVM :: tools/llvm-objcopy/ELF/compress-debug-sections-zstd-err.test

These tests are only failing on the UGent cluster "doduo" which is running RHEL 9.4
They're not failing on:

  • jsc-zen3 test cluster, which runs Rocky Linux 9.5, cfr. test report);
  • UGent cluster "doduo" when using Rocky Linux 8.10 container (via shell docker://ghcr.io/easybuilders/rockylinux-8.10), cfr. test report;

More details on the failing tests:

for failing MC/ELF/compress-debug-sections-zstd-unavailable.s:

Details
FAIL: LLVM :: MC/ELF/compress-debug-sections-zstd-unavailable.s (30050 of 46678)
******************** TEST 'LLVM :: MC/ELF/compress-debug-sections-zstd-unavailable.s' FAILED ********************
Script:
--
: 'RUN: at line 2';   not /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/llvm-mc -filetype=obj -compress-debug-sections=zstd -triple x86_64 /tmp/vsc40023/easybuild_build/LLVM/16.00
.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/MC/ELF/compress-debug-sections-zstd-unavailable.s 2>&1 | /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/FileCheck /tmp/vsc400233
/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/MC/ELF/compress-debug-sections-zstd-unavailable.s
--
Exit Code: 1

Command Output (stderr):
--
/tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/MC/ELF/compress-debug-sections-zstd-unavailable.s:4:10: error: CHECK: expected string not found in input
# CHECK: error: --compress-debug-sections: LLVM was not built with LLVM_ENABLE_ZSTD or did not find zstd at build time
         ^
<stdin>:1:1: note: scanning from here
^?ELF^B^A^A^@^@^@^@^@^@^@^@^@^A^@>^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@p^@^@^@^@^@^@^@^@^@^@^@@^@^@^@^@^@@^@^D^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@.text^@.strtab^@.symtab^@^@^@^@^@@
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^G^@^@^@^C^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@X^@^@^@^@^@^@^@^W^@^@^@^@^@^@^@^@^^
@^@^@^@^@^@^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^A^@^@^@^A^@^@^@^F^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^D^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^O^@^@^@^B^@^@^@^@^@^@^@^@^@^@^@@
^@^@^@^@^@^@^@^@@^@^@^@^@^@^@^@^X^@^@^@^@^@^@^@^A^@^@^@^A^@^@^@^H^@^@^@^@^@^@^@^X^@^@^@^@^@^@^@
^

Input file: <stdin>
Check file: /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/MC/ELF/compress-debug-sections-zstd-unavailable.s

-dump-input=help explains the following input dump.

Input was:
<<<<<<
         1: ^?ELF^B^A^A^@^@^@^@^@^@^@^@^@^A^@>^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@p^@^@^@^@^@^@^@^@^@^@^@@^@^@^@^@^@@^@^D^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@.text^@.strtab^@.symtt
ab^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^G^@^@^@^C^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@X^@^@^@^@^@^@^@^W^@^@^^
@^@^@^@^@^@^@^@^@^@^@^@^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^A^@^@^@^A^@^@^@^F^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^D^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^O^@^@^@^B^@^@^@^@^@@
^@^@^@^@^@^@^@^@^@^@^@^@^@^@@^@^@^@^@^@^@^@^X^@^@^@^@^@^@^@^A^@^@^@^A^@^@^@^H^@^@^@^@^@^@^@^X^@^@^@^@^@^@^@
check:4     X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
>>>>>>

for failing tools/llvm-objcopy/ELF/compress-debug-sections-zstd-err.test:

Details
UNSUPPORTED: LLVM :: tools/llvm-objcopy/ELF/compress-debug-sections-zstd.test (43705 of 46678)
...
******************** TEST 'LLVM :: tools/llvm-objcopy/ELF/compress-debug-sections-zstd-err.test' FAILED ********************
Script:
--
: 'RUN: at line 2';   /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/yaml2obj /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/tools/llvmm
-objcopy/ELF/Inputs/compress-debug-sections.yaml -o /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/test/tools/llvm-objcopy/ELF/Output/compress-debug-sections-zstd-err.test.tmp
: 'RUN: at line 3';   not /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/llvm-objcopy --compress-debug-sections=zstd /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm..
obj.1/test/tools/llvm-objcopy/ELF/Output/compress-debug-sections-zstd-err.test.tmp /dev/null 2>&1 | /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/FileCheck /tmp/vsc40023/easybuill
d_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/tools/llvm-objcopy/ELF/compress-debug-sections-zstd-err.test
--
Exit Code: 2

Command Output (stderr):
--
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm.obj.1/bin/FileCheck /tmp/vsc40023/easybuild_build/LLVM/16.0.6/GCCcore-12.3.0/llvm-project-16.0.6.src/llvm/test/tools//
llvm-objcopy/ELF/compress-debug-sections-zstd-err.test

--

This seems like a problem with the tests more than anything, so we'll circumvent those test failures for now by either filtering them out in the LLVM 16.0.6 easyconfigs, or by allowing up to 2 failing tests for LLVM 16.0.6

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions