Many of the earliest computer mice actually used three mouse buttons. The common two button mice we know today came about when designers realized a third button wasn't necessary for most use cases. In an attempt at even further simplification, Apple popularized one button mice as well.
Three button mice
Two button mice
Other pictures