Well I've never disliked Jeremiah, I just always found him to be either painfully boring, or annoying when he was in power. But I'm randomly starting to warm up to his presence, despite him being completely irrelevant.
You should watch his Survivor cbs confessionals. Someone tallied how many times he said 'you know' in a minute and it was 23 or something. Dull dull dull, but I do like him in a way :p