Kanye's not so bad that it's like "boycott places that hire him" or something like that, but his behavior is obnoxious, stupid and promotes bad things and makes me less inclined to like him, which bleeds over into my opinion of his music.
I already knew he was an asshat when Yeezus came out, but it still had some good songs on it (but also things pointed out like using a sample of a song about lynching to talk about some petty personal drama or whatever).
He'll be fine but if he wants to go around spewing alienating shit to his fans, he's going to alienate some of them