Will I still have access to the emails that I moved from the Outlook Inbox to folders that are labled "On my computer"?
Your understanding is correct. Archives are stored on your local computers. So those messages will stay on your machine. However, like any files on your system, you should make back-ups for your archive. This is to prevent loss of data in the event of computer failure.