I actually suspect either we are at the east gate, or there isn't one. If there is one that we aren't at, though, the guard seemed to be implying we might be able to get in, there.
And if we do need to scale a wall, that's pretty much the sort of thing Aroth is trained to do.