You’re probably at the edge of the bus line. There’s a usually very empty bus every 30 minutes just a block away from me. I took that bus a few times and realized that my neighborhood is the turn around for it. Most of the folk on it have gotten off by the time it loops through.
This situation of empty busses at houses makes sense too. Why would a bus be full at the edge of town? It needs passengers first and they won’t accumulate until the bus is near populated spots like downtown. And why would a city pay for empty busses when they could route them in better areas?
Wow, that’s not great. You have my condolences and I hope you manage to convince your city to put some money into a frontage road or path of some sort. I’ve seen some pretty nice rail trails and the like in very small communities, but they take a lot of work and time.