@Jeremy - Nope. I tried adding my personal Twitter account to Publicize on the same page and didn't have any issues.

Interesting. I just removed the button and went through the process of adding it again and this time, everything worked as expected. The create service popup didn't stay on the screen and the button was created.