I dislike Jetpack with a passion, but one thing I can not see any issue with, is it's performance. There is bound to be some inefficiencies here and there, just like with other plugins, but I'm yet to see any noticeable lag or fundamental problems which would make it's performance notably bad in comparison to other plugins. If anything I suspect it's performance would be significantly better than the average plugin.