Carroll played amateur hockey in his hometown for almost his entire career. In November, 1924 he was signed as a free agent by the expansion Montreal Maroons. A month later he was traded to the Boston Bruins. In February he was released by the Bruins and re-signed with the Maroons. In that busy season, he played in 16 games and scored no points. He retired in 1926.