Bug Report T555668
Visible to All Users

Test Runner - Combinatorial / Pairwise NUnit testing with TestRunner enabled causes Visual Studio to hang / become unresponsive

created 7 years ago

Hello,
With TestRunner enabled in the CodeRush options, if you have NUnit tests that make use of Combinatorial / Pairwise testing then Visual Studio becomes really slow to respond a lot of the time, and more often than not it is completely unresponsive.

Disabling TestRunner fixes this issue.

Have the TestRunner window open or closed does not appear to make any difference.

My guess is that CodeRush is still compiling the list of all possible tests that could be carried out, and in some cases our unit tests are generating 100s and 1000s of possible combinations.

Show previous comments (4)
DevExpress Support Team 7 years ago

    Hi Ben,

    Thank you for taking the time and collecting this data.
    Please give us some time for research. We will contact you shortly.

    DevExpress Support Team 7 years ago

      Hi Ben,

      We've analyzed the report file and see the problem.
      I also recreated the solution containing 20 tests, which generate more than 20000 test cases and see significant slowdown when I run the tests and then do changes in the editor.
      Please give us some time to prepare a fix. We will contact you when changes are ready.

        Great that you can reproduce the issue, thanks for keeping me updated.

        Answers approved by DevExpress Support

        created 7 years ago

        We have fixed the issue described in this ticket and will include the fix in our next maintenance update. To apply this solution before the official update, request a hotfix by clicking the corresponding link for product versions you require.

        Note: Hotfixes may be unavailable for beta versions and updates that are about to be released.

          Disclaimer: The information provided on DevExpress.com and affiliated web properties (including the DevExpress Support Center) is provided "as is" without warranty of any kind. Developer Express Inc disclaims all warranties, either express or implied, including the warranties of merchantability and fitness for a particular purpose. Please refer to the DevExpress.com Website Terms of Use for more information in this regard.

          Confidential Information: Developer Express Inc does not wish to receive, will not act to procure, nor will it solicit, confidential or proprietary materials and information from you through the DevExpress Support Center or its web properties. Any and all materials or information divulged during chats, email communications, online discussions, Support Center tickets, or made available to Developer Express Inc in any manner will be deemed NOT to be confidential by Developer Express Inc. Please refer to the DevExpress.com Website Terms of Use for more information in this regard.