Thế was born in Tây Ninh Province and raised in the Cao Đài religion. He was trained in military officer school by the Japanese Kempeitai when Japan began using Cao Đài paramilitary troops. By 1945, he was an officer in the Cao Đài militia.