Amy was born in Houston, Texas. He learned how to play clarinet before joining the Army, and during his time in service, picked up the tenor saxophone. After his discharge, he attended and graduated from Kentucky State College. He worked as an educator in Tennessee while playing in midwestern jazz clubs. In the mid-1950s he relocated to Los Angeles and signed with Pacific Jazz Records, often playing with organist Paul Bryant. In the mid-60s he spent three years as musical director of Ray Charles' orchestra, together with his wife, Merry Clayton and Steve Huffsteter.
As well as leading his own bands and recording albums under his own name, Amy also did session work and played the solos on several recordings, including The Doors song "Touch Me", Carole King's Tapestry, and Lou Rawls' first albums, Black and Blue and Tobacco Road, coinciding with Dexter Gordon in the Onzy Matthews big band, as well as working with Marvin Gaye, Tammy Terrell and Smokey Robinson.
- 1955: Jazz Recital - Dizzy Gillespie
- 1960: The Blues Message aka This Is The Blues (Kimberly) - with Paul Bryant
- 1961: Groovin' Blue (Pacific Jazz) - with Frank Butler
- 1961: Meetin' Here (Pacific Jazz) - with Bryant
- 1962: Way Down (Pacific Jazz) - with Victor Feldman
- 1962: Tippin' on Through - Recorded "Live" at The Lighthouse (Pacific Jazz )
- 1963: Katanga! (Pacific Jazz) - with Dupree Bolton and guitarist Ray Crawford, pianist Jack Wilson, bassist Victor Gaskin, and drummer Doug Sides
- 1965: The Sounds of Broadway / the Sounds of Hollywood (Palomar)
- 1966: Mustang (Verve)
- 1971: Tapestry - Carole King
- 1994: Peace for love (Fresh Sound)