People use it all the time to pass off responsibility for their words onto the recipient. It's a way of pretending like one can automatically absolve themself from the consequences of their words and negate any sort of response. If you got upset by something that someone was "just sayin", the implication is that it is your fault for getting upset by it because hey, they were just sayin.