Steinberg was in the group from 1962 to 1965. He is featured on "Green Onions", its B-side, "Behave Yourself," and the Green Onions album. He recorded one more album with the band, Soul Dressing in 1965. Unlike the first album, every song but one on Soul Dressing was an original. When Steinberg stepped aside, Donald "Duck" Dunn took over on bass.