Upgrading to 3.0.0 causes System.MissingMethodException: Method not found: 'Boolean Microsoft.VisualStudio.TestPlatform.CoreUtilities.Helpers.CommandLineArgumentsHelper.TryGetIntArgFromDict

[abatishchev]

My service is built using Azure DevOps:

Current agent version: '2.175.2'

If I upgrade to version 3.0.0 my tests fail with error:

Starting: Running tests from ResourceProviderService.Tests.Functional
==============================================================================
Task         : .NET Core
Description  : Build, test, package, or publish a dotnet application, or run a custom dotnet command
Version      : 2.179.2
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/build/dotnet-core-cli
==============================================================================
C:\windows\system32\chcp.com 65001
Active code page: 65001
Info: .NET Core SDK/runtime 2.2 and 3.0 are now End of Life(EOL) and have been removed from all hosted agents. If you're using these SDK/runtimes on hosted agents, kindly upgrade to newer versions which are not EOL, or else use UseDotNet task to install the required version.
C:\dotnet\dotnet.exe test C:\azagent\_work\1\a\Service.Tests.Functional\Service.Tests.Functional.dll --logger trx --results-directory C:\azagent\_work\_temp --settings C:\azagent\_work\1\a/Service.Tests.Functional/RunSettings/FunctionalTests.Dev.RunSettings
Microsoft (R) Test Execution Command Line Tool Version 16.7.0
Copyright (c) Microsoft Corporation.  All rights reserved.

Starting test execution, please wait...

A total of 1 test files matched the specified pattern.
Testhost process exited with error: Unhandled exception. System.MissingMethodException: Method not found: 'Boolean Microsoft.VisualStudio.TestPlatform.CoreUtilities.Helpers.CommandLineArgumentsHelper.TryGetIntArgFromDict(System.Collections.Generic.IDictionary`2<System.String,System.String>, System.String, Int32 ByRef)'.
   at Microsoft.VisualStudio.TestPlatform.TestHost.DefaultEngineInvoker.SetParentProcessExitCallback(IDictionary`2 argsDictionary)
   at Microsoft.VisualStudio.TestPlatform.TestHost.DefaultEngineInvoker.Invoke(IDictionary`2 argsDictionary)
   at Microsoft.VisualStudio.TestPlatform.TestHost.Program.Run(String[] args)
   at Microsoft.VisualStudio.TestPlatform.TestHost.Program.Main(String[] args)
. Please check the diagnostic logs for more information.
Results File: C:\azagent\_work\_temp\testagent000000$_testagent000000_2021-01-12_19_59_37.trx

Rolling back to 1.3.0 makes the issue to disappear.

Other installed packages:

<ItemGroup>
  <PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.8.3" />
  <PackageReference Include="MSTest.TestAdapter" Version="2.1.2" />
  <PackageReference Include="MSTest.TestFramework" Version="2.1.2" />
  <PackageReference Include="coverlet.collector" Version="1.3.0">
    <PrivateAssets>all</PrivateAssets>
    <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
  </PackageReference>
</ItemGroup>

[Kampfmoehre]

Discovering the same problem with Net 5. I have an integration test project that looks similar to the one from the MS docs. Is there anything I can provide for further investigation of the issue?

  <ItemGroup>
    <PackageReference Include="coverlet.collector" Version="3.0.0">
      <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
      <PrivateAssets>all</PrivateAssets>
    </PackageReference>
    <PackageReference Include="coverlet.msbuild" Version="3.0.0">
      <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
      <PrivateAssets>all</PrivateAssets>
    </PackageReference>
    <PackageReference Include="JUnitTestLogger" Version="1.1.0" />
    <PackageReference Include="Microsoft.AspNetCore.Mvc.Testing" Version="5.0.2" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.InMemory" Version="5.0.2" />
    <PackageReference Include="Microsoft.EntityFrameworkCore.Relational" Version="5.0.2" />
    <PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.8.3" />
    <PackageReference Include="Moq" Version="4.15.2" />
    <PackageReference Include="xunit" Version="2.4.1" />
    <PackageReference Include="xunit.runner.visualstudio" Version="2.4.3">
      <IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
      <PrivateAssets>all</PrivateAssets>
    </PackageReference>
  </ItemGroup>

Here are some of the build warnings:

/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "System.Void Microsoft.Extensions.Hosting.BackgroundService::.ctor()", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.IntegrationTests/<ProjectName>.IntegrationTests.csproj]
/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "Microsoft.Extensions.Hosting.IHost Microsoft.Extensions.Hosting.IHostBuilder::Build()", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.IntegrationTests/<ProjectName>.IntegrationTests.csproj]
/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "Microsoft.AspNetCore.Builder.IApplicationBuilder Microsoft.AspNetCore.Builder.AuthorizationAppBuilderExtensions::UseAuthorization(Microsoft.AspNetCore.Builder.IApplicationBuilder)", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.UnitTest/<ProjectName>.UnitTest.csproj]
/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "Microsoft.AspNetCore.Builder.IApplicationBuilder Microsoft.AspNetCore.Builder.AuthAppBuilderExtensions::UseAuthentication(Microsoft.AspNetCore.Builder.IApplicationBuilder)", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.UnitTest/<ProjectName>.UnitTest.csproj]
/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "Microsoft.Extensions.DependencyInjection.IServiceCollection Microsoft.Extensions.DependencyInjection.ServiceCollectionServiceExtensions::AddScoped<<ProjectName>.Services.IDeviceService,<ProjectName>.Services.DeviceService>(Microsoft.Extensions.DependencyInjection.IServiceCollection)", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.IntegrationTests/<ProjectName>.IntegrationTests.csproj]
/home/<username>/.nuget/packages/coverlet.msbuild/3.0.0/build/coverlet.msbuild.targets(39,5): warning : [coverlet] Unable to resolve method reference "Microsoft.Extensions.DependencyInjection.IServiceCollection Microsoft.Extensions.DependencyInjection.RoutingServiceCollectionExtensions::AddRouting(Microsoft.Extensions.DependencyInjection.IServiceCollection,System.Action`1<Microsoft.AspNetCore.Routing.RouteOptions>)", assuming calls to will return [/home/<username>/dev/<project>/test/<ProjectName>.IntegrationTests/<ProjectName>.IntegrationTests.csproj]
[/home/<username>/dev/<project>/test/<ProjectName>.IntegrationTests/<ProjectName>.IntegrationTests.csproj]
Microsoft (R) Test Execution Command Line Tool Version 16.8.1
Copyright (c) Microsoft Corporation.  All rights reserved.

[MarcoRossignoli]

Can someone create a small repro?

[fredrikcarlbom]

Can someone create a small repro?

https://github.com/fredrikcarlbom/coverlet

[MarcoRossignoli]

@fredrikcarlbom for now you can try with dotnet test --collect:"XPlat Code Coverage" your sample is working on my test.

❯ dotnet test --collect:"XPlat Code Coverage"
  Determining projects to restore...
  All projects are up-to-date for restore.
  You are using a preview version of .NET. See: https://aka.ms/dotnet-core-preview
  You are using a preview version of .NET. See: https://aka.ms/dotnet-core-preview
  lib1 -> C:\git\coverletissue\coverlet\lib1\bin\Debug\net5.0\lib1.dll
  lib1.tests -> C:\git\coverletissue\coverlet\lib1.tests\bin\Debug\net5.0\lib1.tests.dll
Test run for C:\git\coverletissue\coverlet\lib1.tests\bin\Debug\net5.0\lib1.tests.dll (.NETCoreApp,Version=v5.0)
Microsoft (R) Test Execution Command Line Tool Version 16.9.0
Copyright (c) Microsoft Corporation.  All rights reserved.

Starting test execution, please wait...
A total of 1 test files matched the specified pattern.

Attachments:
  C:\git\coverletissue\coverlet\lib1.tests\TestResults\948060e5-f4c8-4a66-b4b2-df5b4e1e5af9\coverage.cobertura.xml
Passed!  - Failed:     0, Passed:     1, Skipped:     0, Total:     1, Duration: 2 ms - lib1.tests.dll (net5.0)
 C:\git\coverletissue\coverlet   main ≣ +0 ~1 -0 ! 

Investigating publish scenario

[MarcoRossignoli]

@fredrikcarlbom @abatishchev can you try with this preview version?

Preview.zip

[Kampfmoehre]

This resolves it for me on my Fedora machine.

I installed it with
dotnet add test/<ProjectName>.IntegrationTests/ package --source /home/<user>/Downloads/ --prerelease coverlet.collector
and
dotnet add test/<ProjectName>.IntegrationTests/ package --source /home/<user>/Downloads/ --prerelease coverlet.msbuild