I was just wondering this as well. Maybe he is such a charmer that he was able to talk his way past some guards? Or, could it be that the restriction was lifted after Macht was dealt with? Frieren and gang did go the long way because she didn’t know that the fancy new road had been built.