A pity that this enhancement got moved to a future release:

https://core.trac.wordpress.org/ticket/23205

It's annoying to have to select "uploaded to this post" everytime you open the media manager.