2 simple steps needed to remove a specific user access to your store:
Go to Manage Users page through Configuration -> Account -> Users from the sidebar menu
Open the user and remove access by click the red button:
Note that if you have multiple stores with common users, once you remove a common user from a store, it doesn't remove this user's access from the other stores.