Rose was a mainstay of the jazz scene in San Francisco during the 1940s and 1950s. He was the pianist for Lu Watters's group, the Yerba Buena Jazz Band, for its entire existence, from 1939 to 1950. Following this he played with Bob Scobey (1951) and Turk Murphy (1952-54), then did mainly solo work for the rest of his career. He recorded for Jazz Man Records in 1941-42, did several albums for Good Time Jazz, and also recorded for Columbia Records. He did an album in 1982, which was his first release as a leader in 24 years.