Strange behavior from IDE while running tests

I am following the "How to record and run a Web Test" walkthrough. If I go to the Test View panel and select "Run Selection" on my coded web test, everything goes as expected. However, if I hit F5, as is my habit, it starts by running a manual test (and I tell it to pass this test) and I stop debugging at some point. But then the IDE seems to get stuck in a state between debugging and not-debugging. I cannot edit files without getting a warning dialog about being in debug mode, but the Debug menu shows that I am not debugging. If I try to run just my coded web test (which will normally run fine), it throws an exception. I have to close the IDE and re-open and be careful to only "Run Selection" and not run by f5.

Answer this question

Strange behavior from IDE while running tests

lydiatwin
The stuff that troubles me the most are the IDE issues, but there is also a compiler bug that has been giving me a lot of grief.

The IDE issues are serious things like this:
http://weblogs.asp.net/fbouma/archive/2005/11/03/429371.aspx
and lots of small stuff like this:
http://lab.msdn.microsoft.com/productfeedback/viewfeedback.aspx feedbackid=90692dda-80ea-40ad-9af0-61ec88193d74

The compiler bug is here:
http://lab.msdn.microsoft.com/productfeedback/viewfeedback.aspx feedbackid=eb24881a-87b3-41f3-942c-1c9c944ec03e
Marco Alonso
Have you encountered any fatal errors of things that can't be worked around or is it just IDE related things

I have managed to get the new architecture so we have reduced code writing to around 20% of the code for the backend and 60% for the front-end (only part of that is VS 2005). It'd be hard to ignore that without some serious issues.
Nose
I'm having this problem too, usually around once every 30 debugs of tests. This is with the release version of team suite. I have encountered a few other issues that are also known about.

As we're moving to this IDE en-mass in March I'd like to see MS release a service pack for this product. The regularity that I encounter problems and have to restart the IDE are all too frequent for my tastes - and I'm not even a heavy user yet.
Shailesh Namjoshi
I'm the only one in my company regularly using VS 2005. Everyone else is still working in VS 2003.

However, VS 2005 has many more bugs than VS 2003 and I do not think it would be wise for us to switch the whole team over until there is a service pack released.

I've been using VS 2005 for months now, and whether I'm doing web testing, load testing, or development, there is always some problem.
aconi
Thank you. (And I apologize for posting this issue twice.)
SSotnikov
Yes, F5 runs all the tests in debug mode, and ctrl+F5 runs all tests without debugging. This is by design. You could also use the Run Selection and Debug Selection in test view/manager just like what you are doing.

You problem you are seeing with IDE confused about whether it is in debugging looks like a known issue to us. I will confirm this with my colleagues. But if it is indeed the case, I have to tell you that unfortunately we are not able to fix this for 2005 release. We will consider fixing it either in service pack of VS 2005 or next release.

Thank you for reporting the issue to us. If I have any update about this issue, I will post a message here.

Leo Huang
Dev, VSTS
Cagdas Top
Yes, this happens when there is an exception thrown when debugging, and then VS gets confused about debugging state. Here is a workaround that you could try.

"To prevent this issue, if the exception happens in a non-test project, you can switch to a tool window before switching to a code in the test project. If it happens in the test code, do not leave the code window until you continue (F5)."

Thanks,
Leo Huang
Dev, VSTS
Russt
Here is the exception. The problem must be in my code, but I cannot understand why the IDE is getting stuck between a debugging/not debugging state.

Hope this feedback helps.

System.Collections.Generic.KeyNotFoundException was unhandled by user code
Message="The given key was not present in the dictionary."
Source="mscorlib"
StackTrace:
       at System.ThrowHelper.ThrowKeyNotFoundException()
       at System.Collections.Generic.Dictionary`2.get_Item(TKey key)
       at Microsoft.VisualStudio.TestTools.WebTesting.WebTestContext.get_Item(String key)
       at TestProject1.WebTest1Coded.<GetRequestEnumerator>d__0.MoveNext() in M:\Visual Studio Projects\TestProject1\TestProject1Sln\TestProject1\WebTest1Coded.cs:line 89
       at Microsoft.VisualStudio.TestTools.WebStress.WebTestCaseVariation.ExecuteNextTopLevelRequest()
Strange behavior from IDE while running tests

Answer this question