In reply to Robert Dall.

Thanks so much writer! All I had to do was change my "site address/URL" in the General _> settings from an http://mywebsitedomain.com
to https://mywebsitedomain.com and then WP makes all links use https: