All the buttons become the same size as the anchor button.
The two Push Button items on the Arrange menu control the alignment of push buttons. One centers buttons across the bottom of the dialog box, and the other arranges them down the right side. Use the proper option to arrange the buttons down the right side.