In reply to Peter Wilson.

@Reter, please familiarize yourself with the emoji code before commenting on its impact.The shim itself is 1.5k and you also have a style. It makes the browser work harder in parsing JS and CSS and css style matching might become slower, or do you think browsers use zero effort magic for that?
And this is for all site pages whether they use or do not use emoji in any way.

There is no improvement that needs to be done here, this is an obvious plugin feature that should have never got into core, core has no business emitting JS and CSS, this should have been left to themes and plugins.

As I said in another comment forcing a proper emoji display on the whole internet is as logical as forcing a proper display of hebrew on the whole internet. People that want to see emoji characters can use IE or FF or safari if it is important for them.