As a "rectangular" photographer, however, it appears I'm giving up a photographic tool. I love verticals, yet square photography won't let me choose, at least in the field.
Shooting square is like shooting a horizontal and a vertical frame simultaneously. You can crop a square to go either vertical or horizontal easily.