The fashion world embraced Ye. After his 'White Lives Matter' shirts, that may change