Could be everyone in the tower, even. There were a number of greys in the area, running away after things started getting ugly. The surrounding forest could have been safe, and that's where the prisoners were found.
Also, it could just be the artist, but I get the impression that the Fen assassin is even smaller than the average member of his species.