According to the U.S. Department of State, in 1789 George Washington began the tradition of taking the oath with a hand on the Bible. Presidents can choose another book, for example, John Quincy Adams ...