Surprised there are people out there who don't have it yet. It's been dirt cheap for a while now. And yes, if you suck at gaming in general you will hate Binding of Isaac. It's my go-to game when I'm bored and don't want a long single player odyssey like Civ 5 or something. Each game is completely different and pretty short.
The only thing I dislike about BoI is the lack of native controller support. The game plays wonderfully with a 360 controller. Also an in-game item encyclopedia would be nice... although I've heard some people say that's part of the fun, not knowing or remembering what the 100s of items/cards/trinkets do.
From the same mouth that told me the game was good, I also kept hearing the game is like Zelda. No wonder the game actually turned out to be terrible. I find the art style downright disgusting, on top of it all.