No. The PSP encountered the same situation when Diamond and Pearl came out and it's still sitting pretty, Same goes for when Black and White came out. A lot of people like pokemon, sure, but it's not the greatest game in the world (the last Pokemon game I've ever played was Diamond and it pretty much turned me off the franchise).
The PSP survived Pokemon bombings. That's one way to look at things.
Then again, the PSV isn't really in the same position as the PSP was.
On another angle, the massive hardware inflation the 3DS is about to get from XY and MH will surely add more dev attraction. Maybe even make prospective VITA devs think twice into making a VITA game only.