I checked to make sure I didn't have anything equipped that would be taking it down and found nothing. Could something I ate be effecting this? It's been stuck like that for the past 3 or 4 hours of gameplay.
PSN ID: Ahall89 playing Modern Warfare 3, Gundam 0081, and Battlefield 3 Steam id: AH88
Go to magic, and check active effects. Chances are it's a disease that's sapping a little bit of your stamina. I don't remember the name, but you get it from fighting wildlife. Just go to a altar, or drink a cure disease potion, and you should be right as rain.