Originally Posted by JARblue

I would venture to guess that most people tend to button them from the top button down (I know I do) - hence the term "button down"

However, the term "button up" may stem from the term dress up vs dress down.

Maybe a button down shirt is one with patterns that is informal when compared to a solid white button up shirt that goes with a suit.