Notifications follow the employee's configured reporting method and the notification subscriber list, so a former supervisor keeps receiving them until both are updated.

Update the employee's supervisor (reporting method) to the current manager, then update the subscribers: remove the previous supervisor and confirm the new one is added.

Refer to How can I add or update subscribers to push notifications?