Skip to content

[Android] Add CoreCLR smoke tests for Android #116540

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Jun 26, 2025
Merged

[Android] Add CoreCLR smoke tests for Android #116540

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
097c4da
Add CoreCLR build and test jobs for Android
kotlarmilos Jun 11, 2025
ad3815c
Add smoke tests for CoreCLR Android
kotlarmilos Jun 17, 2025
8f11a91
Remove CoreCLR Android runtime tests
kotlarmilos Jun 17, 2025
2c37ca8
Fix formatting
kotlarmilos Jun 17, 2025
00e3143
Reorder smoke test projects
kotlarmilos Jun 18, 2025
00372a4
Add functional tests as smoke test
kotlarmilos Jun 18, 2025
a6f35f6
Disable failing tests
kotlarmilos Jun 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
114 changes: 76 additions & 38 deletions eng/pipelines/extra-platforms/runtime-extra-platforms-android.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,44 +13,82 @@ jobs:
#
# Build the whole product using Mono for Android and run runtime tests with Android devices
#
# Turn off the runtime testing for now, until https://github.com/dotnet/runtime/issues/60128 gets resolved
# don't run tests on PRs until we can get significantly more devices
# - template: /eng/pipelines/common/platform-matrix.yml
# parameters:
# jobTemplate: /eng/pipelines/common/global-build-job.yml
# helixQueuesTemplate: /eng/pipelines/coreclr/templates/helix-queues-setup.yml
# buildConfig: Release
# runtimeFlavor: mono
# isExtraPlatformsBuild: ${{ parameters.isExtraPlatformsBuild }}
# isAndroidOnlyBuild: ${{ parameters.isAndroidOnlyBuild }}
# platforms:
# - android_arm64
# variables:
# - ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'PullRequest')) }}:
# - name: _HelixSource
# value: pr/dotnet/runtime/$(Build.SourceBranch)
# - ${{ if and(eq(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}:
# - name: _HelixSource
# value: ci/dotnet/runtime/$(Build.SourceBranch)
# - name: timeoutPerTestInMinutes
# value: 60
# - name: timeoutPerTestCollectionInMinutes
# value: 180
# jobParameters:
# testGroup: innerloop
# nameSuffix: AllSubsets_Mono_RuntimeTests
# runtimeVariant: minijit
# buildArgs: -s mono+libs -c $(_BuildConfig)
# timeoutInMinutes: 480
# ${{ if eq(variables['isRollingBuild'], true) }}:
# # extra steps, run tests
# postBuildSteps:
# - template: /eng/pipelines/common/templates/runtimes/build-runtime-tests-and-send-to-helix.yml
# parameters:
# creator: dotnet-bot
# testRunNamePrefixSuffix: Mono_$(_BuildConfig)
# extraVariablesTemplates:
# - template: /eng/pipelines/common/templates/runtimes/test-variables.yml
- template: /eng/pipelines/common/platform-matrix.yml
parameters:
jobTemplate: /eng/pipelines/common/global-build-job.yml
helixQueuesTemplate: /eng/pipelines/coreclr/templates/helix-queues-setup.yml
buildConfig: Release
runtimeFlavor: mono
isExtraPlatformsBuild: ${{ parameters.isExtraPlatformsBuild }}
isAndroidOnlyBuild: ${{ parameters.isAndroidOnlyBuild }}
platforms:
- android_arm64
variables:
- ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: pr/dotnet/runtime/$(Build.SourceBranch)
- ${{ if and(eq(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: ci/dotnet/runtime/$(Build.SourceBranch)
- name: timeoutPerTestInMinutes
value: 60
- name: timeoutPerTestCollectionInMinutes
value: 180
jobParameters:
testGroup: innerloop
nameSuffix: AllSubsets_Mono_RuntimeTests
runtimeVariant: minijit
buildArgs: -s mono+libs -c $(_BuildConfig)
timeoutInMinutes: 480
${{ if eq(variables['isRollingBuild'], true) }}:
# extra steps, run tests
postBuildSteps:
- template: /eng/pipelines/common/templates/runtimes/build-runtime-tests-and-send-to-helix.yml
parameters:
creator: dotnet-bot
testRunNamePrefixSuffix: Mono_$(_BuildConfig)
extraVariablesTemplates:
- template: /eng/pipelines/common/templates/runtimes/test-variables.yml

#
# Build the whole product using CoreCLR for Android and run runtime tests with Android devices
Copy link

Copilot AI Jun 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[nitpick] The CoreCLR and Mono job definitions share many similar parameters. Consider abstracting the common parts into a reusable template to reduce duplication and simplify maintenance.

Copilot uses AI. Check for mistakes.
#
- template: /eng/pipelines/common/platform-matrix.yml
parameters:
jobTemplate: /eng/pipelines/common/global-build-job.yml
helixQueuesTemplate: /eng/pipelines/coreclr/templates/helix-queues-setup.yml
buildConfig: Release
runtimeFlavor: coreclr
isExtraPlatformsBuild: ${{ parameters.isExtraPlatformsBuild }}
isAndroidOnlyBuild: ${{ parameters.isAndroidOnlyBuild }}
platforms:
- android_arm64
variables:
- ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: pr/dotnet/runtime/$(Build.SourceBranch)
- ${{ if and(eq(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: ci/dotnet/runtime/$(Build.SourceBranch)
- name: timeoutPerTestInMinutes
value: 60
- name: timeoutPerTestCollectionInMinutes
value: 180
jobParameters:
testGroup: innerloop
nameSuffix: AllSubsets_CoreCLR_RuntimeTests
runtimeVariant: jit
buildArgs: -s clr+libs -c $(_BuildConfig)
timeoutInMinutes: 480
${{ if eq(variables['isRollingBuild'], true) }}:
# extra steps, run tests
postBuildSteps:
- template: /eng/pipelines/common/templates/runtimes/build-runtime-tests-and-send-to-helix.yml
parameters:
creator: dotnet-bot
testRunNamePrefixSuffix: CoreCLR_$(_BuildConfig)
extraVariablesTemplates:
- template: /eng/pipelines/common/templates/runtimes/test-variables.yml

#
# Android devices
Expand Down
40 changes: 40 additions & 0 deletions eng/pipelines/extra-platforms/runtime-extra-platforms-androidemulator.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ parameters:

jobs:

#
# Build the whole product using Mono for Android and run runtime tests with Android emulator
#
- template: /eng/pipelines/common/platform-matrix.yml
Expand Down Expand Up @@ -48,6 +49,45 @@ jobs:
extraVariablesTemplates:
- template: /eng/pipelines/common/templates/runtimes/test-variables.yml

#
# Build the whole product using CoreCLR for Android and run runtime tests with Android emulator
#
- template: /eng/pipelines/common/platform-matrix.yml
parameters:
jobTemplate: /eng/pipelines/common/global-build-job.yml
helixQueuesTemplate: /eng/pipelines/coreclr/templates/helix-queues-setup.yml
buildConfig: Release
runtimeFlavor: coreclr
isExtraPlatformsBuild: ${{ parameters.isExtraPlatformsBuild }}
isAndroidEmulatorOnlyBuild: ${{ parameters.isAndroidEmulatorOnlyBuild }}
platforms:
- android_x64
variables:
- ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: pr/dotnet/runtime/$(Build.SourceBranch)
- ${{ if and(eq(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}:
- name: _HelixSource
value: ci/dotnet/runtime/$(Build.SourceBranch)
- name: timeoutPerTestInMinutes
value: 60
- name: timeoutPerTestCollectionInMinutes
value: 180
jobParameters:
testGroup: innerloop
nameSuffix: AllSubsets_CoreCLR_RuntimeTests
runtimeVariant: jit
buildArgs: -s clr+libs -c $(_BuildConfig)
timeoutInMinutes: 240
# extra steps, run tests
postBuildSteps:
- template: /eng/pipelines/common/templates/runtimes/build-runtime-tests-and-send-to-helix.yml
parameters:
creator: dotnet-bot
testRunNamePrefixSuffix: CoreCLR_$(_BuildConfig)
extraVariablesTemplates:
- template: /eng/pipelines/common/templates/runtimes/test-variables.yml

#
# Build the whole product using Mono for Android and run runtime tests with interpreter
#
Expand Down
Loading