In reply to Paul.

I've been down that route, but keeping up with constant changes to core block markup is also quite painful. So what I've been playing with recently is a middle ground: Building an altered version of core styles. I've also blogged about it, thought you might find this interesting: https://kraftner.com/en/blog/building-your-own-wordpress-core-block-css/