How to remove task assignee or watcher?

To remove the assignee or watcher of a task, please just click again on the same user. This way you can also set a task as unassigned again.