They released albums Tricks of the Shade (1992) (produced by producer Joe "the Butcher" Nicolo) and No Goats, No Glory (1994), on Ruffhouse Records and Columbia Records respectively. Both albums have since gone out of print. No Goats, No Glory peaked at No. 58 in the UK Albums Chart in August 1994.
Two singles were released from the album, "¿Do The Digs Dug?" and "Typical American", the latter of which appeared on Ruffhouse Records' final release in 1999, the greatest hits compilation Ruffhouse Records Greatest Hits. The album has since gone out-of-print.
No Goats, No Glory is the second and final album released by The Goats. It was released on September 20, 1994 through Ruffhouse Records with production handled by both The Goats and Joe "The Butcher" Nicolo. After the release of the first album, lead rapper Oatie Kato had left the group leaving Madd and Swayzack to continue the Goats as a duo. The album was not as critically successful as Tricks of the Shade, as many felt the content of this album was inferior to Tricks of the Shade.