For all those accusing mayweather of ducking?

Does "Mayweather camp not giving up" really matter? There's multiple top tier competitors out there that that he won't fight anyway.