The idea of Wobbuffet is to deal back damage using Counter and Mirror Coat. Having high HP and low-ish defenses are good for this, dealing back tons of damage. Wobboffet isn't meant to be a wall. Taking less damage after defense boosts would also mean you're dealing less damage back. That defeats the purpose of Wobboffet.
Recover would be great, though. Probably too broken, though.