What type of email account do you have configured?
Try opening Outlook in Safe mode. Does it work as expected? (Hold Ctrl as you click on the Outlook icon to start in Safe mode.)
Is Outlook closing completely when you exit? Check task manager, processes tab for outlook.exe right after closing outlook. It should close within a few seconds, definitely within a minute. When outlook doesn't close cleanly, some settings aren't saved.