Bug Report T1229001
Visible to All Users

Test Runner fails to detect MSTests under certain circumstances

created 10 months ago

I ran into a problem sometime in the last 8-12 months where Test Runner stopped detecting and running tests. It's only now that I've managed to duplicate the issue with sample code.

In the attached solution there is a basic system to support the tests required and two test projects

  • MSTestApi.Tests - using the MS Test framework
  • TestApi.Tests - using the xUnit framework

There are two main test classes in each

  • AuditTestServiceTests
  • TestServiceTests

The MS Test project has additional classes to illustrate the problem. If you run the tests in Test Runner for the solution attached as is you'll get the following output

Clipboard-File-1.png

If you open the AuditTestServiceTests class in the MSTestApi.Tests project and uncomment the AuditTest_BreaksTestDetection test and rerun the test in Test Runner you get the following

Clipboard-File-2.png

Only tests in the MSTestApi.Tests project that were sequenced before the uncommented test are now discovered and run. The xUnit project runs as expected. Using Visual Studio's Test Explorer finds and runs all tests in both projects regardless.

Comments (1)
PW PW
Przemyslaw Wlodarczak (DevExpress) 10 months ago

    Chris,

    Thank you for such a detailed report. I used your test project and reproduced the issue. We will work on a fix.

    Answers approved by DevExpress Support

    created 10 months ago

    We have addressed the issue described in this ticket and will include a fix in our next maintenance update. Should you need to apply our fix prior to official release, you can request a hotfix here.

    Important Notes:

    • Hotfixes may be unavailable for Early Access/Beta builds or updates set for release within a week.
    • .NET only: in the NuGet Package Manager, use your personal NuGet feed and check the "Include prerelease" option to view the hotfix package in the "Updates" tab.
      Comments (3)
      PW PW
      Przemyslaw Wlodarczak (DevExpress) 9 months ago

        Chris,

        Do you mind if we make this ticket public, so that we can include it in the list of fixed issues for the next release?

        CH CH
        Chris Hewitt (Licence) 9 months ago

          Yes, that's fine

          PW PW
          Przemyslaw Wlodarczak (DevExpress) 9 months ago

            Thank you.

            Disclaimer: The information provided on DevExpress.com and affiliated web properties (including the DevExpress Support Center) is provided "as is" without warranty of any kind. Developer Express Inc disclaims all warranties, either express or implied, including the warranties of merchantability and fitness for a particular purpose. Please refer to the DevExpress.com Website Terms of Use for more information in this regard.

            Confidential Information: Developer Express Inc does not wish to receive, will not act to procure, nor will it solicit, confidential or proprietary materials and information from you through the DevExpress Support Center or its web properties. Any and all materials or information divulged during chats, email communications, online discussions, Support Center tickets, or made available to Developer Express Inc in any manner will be deemed NOT to be confidential by Developer Express Inc. Please refer to the DevExpress.com Website Terms of Use for more information in this regard.