If the widget serves a direct, useful purpose to operating the site, I'd like to see them stay or at least be optional. For example, Janis Elst's Broken Link Checker plugin provides a stupendously convenient (for me) dashboard widget; checking the link status is part of my periodic chores list.