Yes, you can search for custom labels using keywords as well as the list of all Custom Labels which are present in org.
- Go to the Metadata Search tab
- Toggle on the Custom Labels toggle and search the results.
For listing all the Custom Labels in the org -
- Go to the Metadata Search tab
- Click on the List All icon near the Custom Labels entity.
- It will redirect you to the List All page where you can see all Custom Labels which are present in Org.