@Danny Freebie caching of whole pages is right out, but you can still manually build caching into your theme. Things like the current list of posts on the front page doesn't change. The tag clouds can be cached.

Caching doesn't have to be an all or nothing thing. It just means you have to do some work to put it in place.