I think you're just having weird luck with parties in your lobbies. For the most part, you should see a range of stats.
Either way, TDM is a mode where I feel stats aren't even a remotely reliable way to judge a person's ability.
If you consider skill a function of K/D and SPM, TDM is one the most telling modes.
TDM IMO is the most straight forward game mode in CoD, but seems to be the most difficult for players to understand. The Only Objective to kill more than you die, but players can't even do this… Most play like its FFA or KC and if they were to play those game modes they would do much better and win more.