The reason why it does that, is because it's a Microsoft product. My suggestion is to switch to Firefox or Safari.
But seriously, try deleting the plist for the app, and then follow witeshark's advice and repair your permissions.
You mentioned that some sites don't work under Safari? Which ones?