Do you want portability or not? To me that is what it comes down to.
If you don't want to be tethered to your TV you should get a Vita. You are already familiar with portable gaming too. Being forced to sit in the same spot every time you want to play a game or having to move the console around sucks.