Why does it show a notice in wp-admin as well as emailing me?

Because the thing that has broken is the thing an email alert would be sent with.

The notice needs nothing to work and stays until somebody has looked, so it is the real alert. The email is a second copy for whoever is not logged in today — worth sending, because a failure is usually one service refusing one address rather than the whole machine being off the network, so it normally arrives.