This is something I've been trying to get to doing myself. Have been running Apache and company locally on my Windows machine and while they work, I don't necessarily want them running locally - touched upon already in the cleanliness and portability points.

Docker can run directly on Windows 10 Pro, which I have, so have had some success running both the official WordPress image and the Bitnami version (I kind of like the latter as it directly offers the ability to map config and file directories locally). The downside is that each instance needs to run on a different port for localhost, and that's not very memorable.

It's possible to use reverse-proxying to redirect localdomains such as mydomain.com.dev to localhost:port. I've been trying to make this work with the nginx-proxy container with limited success so far. If I can get that last step working, then it's possible to have up-to-date dev software running locally-but-not-locally. Not just WordPress, but other web projects.