It’s mainly a feeling of rejection, as others have said. But also, when I post a non-joke comment that gets downvoted but not replied to, I really want to know what the point of disagreement was. It’s frustrating to not know what nerve I’ve hit. The negative number next to my comment tells me nothing useful.