Skip to content

Extract test summary from build and add to the PR test report #4010

@branfosj

Description

@branfosj

For items like CP2K we run the tests, but allow failures in the test suite. It'd be useful to add the test suite report to the log in the PR.

I.e. in easybuilders/easybuild-easyconfigs#15146 (comment) it'd be useful to have

--------------------------------- Summary --------------------------------
Number of FAILED  tests 18
Number of WRONG   tests 6
Number of CORRECT tests 3604
Total number of   tests 3628
--------------------------------------------------------------------------
Number of LEAKING tests 0
Number of memory  leaks 0
--------------------------------------------------------------------------
GREPME 18 6 3604 0 3628 0

Summary: correct: 3604 / 3628; wrong: 6; failed: 18; 128min
Status: FAILED

included in the build report.

This would also help where people run with --ignore-test-failures.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions