I just timed it on my machine and it tooks 27 seconds but I have a new beefy machine with fast hard drives and 8GB of ram.
Visual Studio is a resource hog, it really takes a fast machine, until I got my new machine I was really getting frustrated with my nearly 3 year old machine.
A couple of tips:
If you aren't using webstore, poll or survey, the copy the mojoportal-core.sln file and give it your own name and then put it back and open it. Remove projects for data layers you aren't using. Te more projects in the solution the longer it takes to load. In any case create a copy of the .sln file you want to work with, rename it then you can drop out of it projects you aren't using.
I hardly ever debug unless I'm really diagnosing a problem. I configure IIS web site, make a change build refresh the browser to test without debugging. Only if something isn't working as expected or if I'm verifying some tricky code is doing what it should, then do I use the debugger.
Hope it helps,
Joe