I don't agree with that at all, and labelling fans of 6 and/or 7 with terms such as 'defensive' and 'rare' is, frankly, rather offensive in my opinion.
I apologize if you feel offended. However, these are, by far, the least popular doctors. In my experience, most people who enjoy the program do not feel these two were very good.
I'm sorry if you feel you have to defend fans of 6 and 7 from accusations of being defensive.
Consider this article in the Guardian which shows that 6 and 7 got the lowest ratings: https://www.theguardian.com/news/datablog/2013/nov/22/doctor-who-best-doctor
There's this Entertainment Weekly poll: https://insidetv.ew.com/2013/11/16/doctor-who-poll/
Here's The Mirror's Poll: https://www.mirror.co.uk/tv/tv-news/doctor-who-50th-anniversary-david-2839056
And then, of course, there is the indisputable fact that after 6+7 had their runs the show was ACTUALLY CANCELLED.
Yes, they have their fans, but of the 12 men who have had the job they again and again prove to be the least popular. And even if one or two fans of theirs might post their love at length, that doesn't mean many agree with them.
Again, I apologize if you are offended, but I believe I'm just stating the honest facts. It's okay to like unpopular things.
EDIT: Or consider the poll above us. 6+7 have the fewest votes of any Doctors in this very thread.