Returning vertical surfaces which face my building

You might also be able to use the same logic as found here:

You can get a surface that maps the closest intersection from your building and use the perimeter to intersect with vertical surfaces.

Just an Idea.