Steinberg was in the group from 1962 to 1965. He is featured on "Green Onions", its B-side, "Behave Yourself," and the Green Onions album. He recorded one more album with the band, Soul Dressing in 1965. Unlike the first album, every song but one on Soul Dressing was an original. About that time, Steinberg left the group and was replaced by Donald "Duck" Dunn.