That sounds awful. I dunno. I mean, at the heart of it all, on some level you’re allowing him to continue this behavior by going to him each time. If you don’t go, he has to either keep calling until you give in, or if you don’t give in, he can get pouty about it, yell about it, or eventually come and actually find you.
If you stand your ground and refuse, eventually he has to change his behavior. But, getting to that point will be very uncomfortable. So the question is, how much do you want things to change? Are you willing to go through that discomfort to get your needs met?
No, it just feels like that because you can’t keep it up anymore.