Thanks, Diane.
No, when I click the All Apps on the main Outlook (365, on the windows computer) window (showing Mail), It is empty and says 'You don't have any Apps yet. Select Add Apps to browse and install Apps'. So, this is definitely not part of the issue I am having, which is related to...