I have a similar problem, maybe not as severe, on same hardware. My collection is much bigger, consisting mainly of epub and mobi with a few pdf's. I've noticed the epubs fly by, the mobi's pause for a second or two while the pdf's take ages per file.