This is plugin territory, putting it in core and removing gravatar would be a step backwards.

Gravatar is an open standard standard that works for everyone. Most commenters/users are simply not going to bother uploading an avatar that is site specific.

If you really need local avatars then there are plugins and/or buddypress

And is you are concerned about privacy cache the avatars locally

Local Avatars in WordPress? No, thanks