This depends on the user's membership in either an Academic or Non-Academic department in Core. To remove a user, follow the steps below.

1. Go to Core > Users/Access > Profile > Edit User Profile Data
2. Search for the user
3. Select the Employment Tab
4. Edit the user's employment.
5. Under the Departments section, remove the user's membership in the departments that should not show in the directory.