I haven’t tried this but it looks very cool: A system tray widget to manage AppPools on your MOSS box. Additionally, you can configure URLs to visit after an IIS Reset or AppPool refresh — that way your sites will automatically get visited after a bounce, reducing the load time when you finally get around to visiting those pages.
I’ve been slowing moving back into the MOSS arena. This widget will definitely get added to my toolbelt.
UPDATE: Forgot to cite my references. I found tell of this in a comment on Sahil Malik’s blog post on his VM setup. (FWIW, I asked him what tools he was using for automation and testing. Strangely that comment didn’t make it past his moderation. Maybe he doesn’t do any testing?)