-
Notifications
You must be signed in to change notification settings - Fork 216
Open
Labels
Description
For items like CP2K we run the tests, but allow failures in the test suite. It'd be useful to add the test suite report to the log in the PR.
I.e. in easybuilders/easybuild-easyconfigs#15146 (comment) it'd be useful to have
--------------------------------- Summary --------------------------------
Number of FAILED tests 18
Number of WRONG tests 6
Number of CORRECT tests 3604
Total number of tests 3628
--------------------------------------------------------------------------
Number of LEAKING tests 0
Number of memory leaks 0
--------------------------------------------------------------------------
GREPME 18 6 3604 0 3628 0
Summary: correct: 3604 / 3628; wrong: 6; failed: 18; 128min
Status: FAILED
included in the build report.
This would also help where people run with --ignore-test-failures.