Yes, you can remove existing permissions using Mass Assign Permissions App.
Steps:
- Go to Mass Assign Field Permissions Tab
- Select Object > Select Profile or Permission Set > Select field
- Click on fetch Field Permissions button
- Uncheck the Checkbox permissions from the user whose permissions you want to remove
- Now click on the Save button