This happened when I disabled rules. I had it running with no actual rules, it it seems it was cutting my site performance in half. As soon as I removed it, performance increased massively by both metrics.
Also, it doesn't seem to use caching at all, as there were quite a lot of largeish SQL queries, dwarfing the stock IPS ones.