Giters

microsoft / testfx-docs

Docs for MSTest V2 test framework

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DataRow execution is not working after 2.2.3 version in VSTest@2 task for Test plan

pmdaware opened this issue · comments

commented

Hi Team,

Below is the code for data row execution.

using Microsoft.VisualStudio.TestTools.UnitTesting;

namespace TestProject1
{

    [TestClass]
    public class UnitTest1
    {
        [DataTestMethod]
        [DataRow(new[] { "Connector_1", "Connector_2", "Connector_3", "Connector_4", "Connector_5", "Connector_6", "Connector_7", "Connector_8", "Connector_9", "Connector_10" })]
        [DataRow(new[] { "Connector_5", "Connector_6", "Connector_7", "Connector_8", "Connector_9", "Connector_10" })]
        [DataRow(new[] { "Connector_1", "Connector_2", "Connector_3", "Connector_4" })]
        [DataRow(new[] { "Connector_2", "Connector_4", "Connector_6", "Connector_8", "Connector_10" })]
        public void TestMethod3( string[] b)
        {

            Assert.AreEqual(b.Length, 4);

        }
    }
}

When we execute using MSTest.TestAdapter & MSTest.TestFramework version 2.2.6

<PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.11.0" />
<PackageReference Include="MSTest.TestAdapter" Version="2.6.0" />
<PackageReference Include="MSTest.TestFramework" Version="2.6.0" />

It was not reporting all data rows to test execution. See below the result which is executed into the pipeline


**************** Starting test execution *********************
Using new test platform for test execution
Microsoft.TestPlatform.VsTestConsole.TranslationLayer.VsTestConsoleWrapper instance will be created
Failed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3 (System.String[])
Adding trx file D:\a\_temp\TestResults\VssAdministrator_WIN-O1PP9NTUSN3_2021-10-07_07_58_00.trx to run attachments
**************** Completed test execution *********************

If we use MSTest.TestAdapter & MSTest.TestFramework version 2.2.3 then it working as expected. Please see the below result for the execution in Azure Pipeline.

**************** Starting test execution *********************
Using new test platform for test execution
Microsoft.TestPlatform.VsTestConsole.TranslationLayer.VsTestConsoleWrapper instance will be created
Failed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3
Failed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3 (System.String[])
Failed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3 (System.String[])
Passed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3 (System.String[])
Failed    TestProject1.UnitTest1.TestMethod3(System.String[])    TestMethod3 (System.String[])
Adding trx file D:\a\_temp\TestResults\VssAdministrator_WIN-O1PP9NTUSN3_2021-10-07_08_02_50.trx to run attachments
**************** Completed test execution *********************

We are using VSTest@2 task in azure devops. Please see below task.

  - task: VSTest@2
    displayName: 'Test using test plans'
    inputs:
      testSelector: 'testPlan'
      testPlan: '23'
      testSuite: '24'
      testConfiguration: '3'
      searchFolder: '$(System.DefaultWorkingDirectory)'
      codeCoverageEnabled: true
      platform: '$(BuildPlatform)'
      configuration: '$(BuildConfiguration)'
    enabled: true
    continueOnError: true