Also relevant: Favicons very well may end up in core eventually: https://core.trac.wordpress.org/ticket/16434