I've definitely done this. Follow people out of politeness then end up muting. But... I follow over 5k people. The algo means I really only see a tiny fraction of those in my feed. Are you seriously expecting me to know what every one is saying and unfollow if problematic?