In reply to Danny Brown.

Beware WordPress Plugin for AMP is only in its first version. Plenty to little tweaks to work for all plugins and themes out there in the wild. You can get some great help from people at Automattic via Github Issues tracker