i'm not sure if I misunderstood, but when I looked in Google Analytics within the page speed section, it seems to shows a really long load time (22 seconds and over) for 'page 2' on my blog. In theory a 'page 2' shouldn't exist with infinite scrolling, so it seems to confuse GA and in turn could/will penalise the site for being slow...