There's not a lot of games out, but if you like every genre (like me) you should be fine. I would recommend going to Gamestop.com or one of the other retailers and just searching the Vita section. Youtube can be great for seeing some game footage.
Look into Silent Hill: Book of Memories. It's not a perfect game, but I've been pretty addicted to it for the last month and a half as I work towards the Platinum.
Edit: I've owned my Vita about 2 months and am still playing my first game. I'm not going to be done with this thing any time soon.
Pretty cheap $230 for the 3G model so you get an 8GB memory card with it since they normally cost $270 (Walmart) or $300 so you get a "discount" and a bigger memory card instead of the Wifi bundles and a game so... up to you.
Awesome! Vitas are amazing. Persona 4 is fantastic. The first 5 games of the metal gear series are playable on vita. Rayman Origins is really cool too :) guacamelee and thomas was alone are great indies, and assassins creed (while I didn't really like it) is basically a console game. Best thing you could do is get a PS+ subscription and a 16GB+ memory card. :)