Just tested out the plugin and it works quite well. Down the road it would be good if you could control what patterns are loaded. In other words, remove the default ones that load with the default Gutenberg install.