Born in Middletown, Connecticut, Wrubel attended Wesleyan University and Columbia University before working in dance bands. "After earning his bachelor’s degree in 1926, Allie enrolled in graduate music studies at Columbia University. He roomed with his close friend, film actor James Cagney [a former Columbia undergrad], and began playing with bands in Greenwich Village and making the rounds on Tin Pan Alley." He played saxophone and clarinet for a variety of famous swing bands. In 1934 he moved to Hollywood to work for Warner Bros. as a contract song writer. He contributed material to a large number of movies, including those of the famous Busby Berkeley before moving to Disney in 1947.