> For a development and staging website you do want notices and warnings displayed.

Just SSH in and tail the log. Dealing with unexpected output from errors clobbering your headers isn't worth the trouble.

You can also try something like FirePHP [0] if you need the errors in the context of the current page.

[0]: http://www.firephp.org/