Hello,
With TestRunner enabled in the CodeRush options, if you have NUnit tests that make use of Combinatorial / Pairwise testing then Visual Studio becomes really slow to respond a lot of the time, and more often than not it is completely unresponsive.
Disabling TestRunner fixes this issue.
Have the TestRunner window open or closed does not appear to make any difference.
My guess is that CodeRush is still compiling the list of all possible tests that could be carried out, and in some cases our unit tests are generating 100s and 1000s of possible combinations.
Hi Ben,
Thank you for contacting us.
Would you please give us more details on your project, such as:
- how large the project is
- how many tests it contain
- whether tests are located in a single file or divided into several test fixtures
- whether you see slowdown when typing or you experience it in other cases
- whether you have slowdown if you work with a small document not containing tests
I look forward to hearing from you.
Hi,
The solution is made up of 63 projects and contains around 220,000 lines of code.
Tests are spread across multiple files in multiple projects and there are 22 coded tests, but with pairwise attribute and range parameters this equates to nearly 11,000 tests.
The slowdown is most notable whilst typing but it has happened just changing windows between code files.
I've not had chance to test with non-test code files yet, but I'll post another comment a bit later when I get chance.
Thanks.
Hi Ben,
Thank for your quick response.
Would you please send us the log files for research.
To collect them, do the following:
- navigate to the logs folder (use the "CodeRush\Support\CodeRush Logs" menu item for that)
- delete all files from this folder
- reopen Visual Studio and reproduce the slowdown
- close Visual Studio
- zip the logs folder and send us the file
It would be also very helpful if you could collect perf view data on this issue using the PerfView tool from Microsoft during the slowdown and provide us with this information.
For this, install this tool and perform the steps shown in the screencast.
I suggest you upload the log files to our ftp. Use the following credentials:
Server: ftp.devexpress.com
User: UPLOAD
Password: HEREYOUARE
Hi, I have uploaded log files and perfview data file as requested.
Hi Ben,
Thank you for taking the time and collecting this data.
Please give us some time for research. We will contact you shortly.
Hi Ben,
We've analyzed the report file and see the problem.
I also recreated the solution containing 20 tests, which generate more than 20000 test cases and see significant slowdown when I run the tests and then do changes in the editor.
Please give us some time to prepare a fix. We will contact you when changes are ready.
Great that you can reproduce the issue, thanks for keeping me updated.