1) Bioshock was designed with consoles in mind, so the controls feels a bit off when played with mouse & keyboard.
2) The story telling is not that great, contrary to popular opinion. Story is basically told 90% through audio logs that are completely optional, but listening to all of them ends up feeling like a chore since they have no direct impact on gameplay. The simple notion that an entire population would keep audio diaries of their lives and then scatter them in public places is super dumb and totally disrupts the immersion for me.
Despite these problems, it's an amazing game. I think what it does right is the level design. Very few games feature environments that look so interesting.
I really like B1, and I think B2 is the best of the series (it improves on almost everything about the first one, only the story, the characters, and maybe the overall atmosphere are inferior to B1, and it's B2 I still replay the most), and I was very disappointed in Bioshock: Infinite. It has great graphics and amazing atmosphere, but the gameplay is very inferior to B1 and B2, and the story has a terrible ending (though the fanboys try to make out it's amazingly deep and and thought-provoking...).
Also, the Bioshock 2 add on, Minerva's Den, is very very good indeed.
Basically, I'd say play B1, then B2 (you really should play B1 first, as it sets the story for B2), then Minerva's Den, then if you want to, play Bioshock: Infinite.
I'm a PC and console gamer - I love good games, regardless of their host system. For all things N64: http://z9.invisionfree.com/Nintendo_64_Forever/