I like the implementation and idea, but I find I don't read as many comments when they're all separated on the sides next to paragraphs, plus it interrupts my reading. It's more natural to read the comments at the end after I've soaked the whole story in.

You could say comments on the side like Medium/QZ is akin to someone constantly interrupting you as you're reading/telling a story... ; )

Ray