In reply to Curious Cat.

The plugin only allows media to be deleted from within the admin area of the shared media library site, not from within sites on the network. This reduces the risk you mentioned a little, but doesn't eliminate it.