Mickey was a music instructor and Sylvia one of his pupils. Baker was inspired to form the group by the success of Les Paul & Mary Ford. They had a Top 20 hit with "Love Is Strange" in 1956, which sold over one million copies and was awarded a gold disc by the RIAA. The duo eventually bought their own nightclub, established a publishing company, and formed their own record label. Although Mickey & Sylvia disbanded by the end of the 1950s, they continued to record together on an infrequent basis until 1965, when Mickey quit the music industry in the United States. A second studio recording of "Love Is Strange" in 1962 featured now-legendary drummer Bernard "Pretty" Purdie, who was 18, on his first paid session gig. "Love Is Strange" would be featured (in its 1956 version) in movies like Dirty Dancing, Badlands and Casino, and would be covered many times.
The reasons the duo split are not entirely clear. Baker subsequently recorded a successful instrumental solo album, The Wildest Guitar. In the 1960s, Baker moved to France and worked with various French musicians. Baker died at his home in Montastruc-la-Conseillère, France on November 27, 2012, at the age of 87.