chore: improve test workflow and coverage reports

[david-luna]

Which problem is this PR solving?

Changes the PR workflow to a single file to improve it making it faster with less resource consumption. The goal is to provide feedback to the PR author by compiling, testing and reporting coverage only for the affected packages in the PR (as for now it does a compilation, test, and coverage report for all in nodejs v18). More details on the plan can be found in #2870

Closes: #2870

Short description of the changes

• add new PR workflow with:
  • single compile step for affected packages. results are cached
  • unit and TAV test for affected packages for a matrix of nodejs versions. Reusing compilation results from cache. coverage reports are cached
  • get coverage reports from all nodejs versions (in cache) and merge them. then upload them to codecov
• add scripts to support such workflow
  • *:ci:affected script at root to execute tasks only for affected packages (leveraging nx CLI)
• update codecov.yml to assign flags to each package so reports can be updated independently
• remove obsolete workflows for unit test and test-all-versions for PRs and push events

Checklist

Codecov flags feature require a first manual upload to create them so it would be helpful to resume #2214 to at least have a script at the root to testa and upload all reports. There is also some PRs that affect the flag configuration so it would be preferable to have them merged 1st

• merge chore: Add docker compose and test services scripts #2886 or at least have a test:with-services script at the root
• merge redis refactor feat(instrumentation-redis)!: consolidate redis v2,3 and redis v4 instrumentation to one package #2915
• merge chore: rename workspace dirs to packages/${package-base-name} (extreme edition) #2928
• manage codecov reports and flags

[david-luna]

@pichlermarc thanks for the approval.

If you don't mind to do another review. I had to change the codecov action but a custom script since there was no options in the action to update flags for each package and adding a codecov step for each package of the repo feels too much.

Until now I've set the --dry-run option so this PR was not messing with the previous reports. Once you have a second look and if all is fine I will proceed to do the actual upload. LAten I will probably need someone with access to codecov to enable flag analytics as described in https://docs.codecov.com/docs/flags#tracking-flag-coverage-over-time

[pichlermarc]

Overall looks good % this comment here #2866 (comment)

[david-luna]

Overall looks good % this comment here #2866 (comment)

@pichlermarc thanks for the review. I fixed it and if you give me the green check I'll remove the --dry-run to actually upload the reports with flags. I may need your help to enable the flags in codecov UI.

[pichlermarc]

looks good, thank you for working on this 🙂

[pichlermarc]

Looks good now - thanks for sorting out the problems with the path 🙂
I'll let you do the honors of merging this in 🙂

[david-luna]

workflow run on main branch https://github.com/open-telemetry/opentelemetry-js-contrib/actions/runs/17457685900