Berg was born in Lafayette, Indiana in 1864. His mother died when he was an infant, and he contracted spinal meningitis as a boy. The illness rendered Berg deaf. Berg was sent to the Indiana Institution for the Deaf in Indianapolis where he was a student for nine years. Several sources report that Berg was an alumnus of Princeton University. Other sources dispute Berg's having any connection with Princeton.