Goldstein studied at the Jewish Theological Seminary and earned a bachelors degree and masters degree at Harvard University. He then earned a doctorate from Columbia University and taught history there for two years. He then taught at the University of Iowa from 1962 to 1997, and lived in Iowa City until his death in 2004.