They released albums Tricks of the Shade (1992) (produced by producer Joe "the Butcher" Nicolo) and No Goats, No Glory (1994), on Ruffhouse Records and Columbia Records respectively. Both albums have since gone out of print. No Goats, No Glory peaked at No. 58 in the UK Albums Chart in August 1994.
Two singles were released from the album, "¿Do The Digs Dug?" and "Typical American", the latter of which appeared on Ruffhouse Records' final release in 1999, the greatest hits compilation Ruffhouse Records Greatest Hits. The album has since gone out-of-print. It was named the 12th best album of 1993 by NME.
No Goats, No Glory is the second and final album released by The Goats. It was released on September 20, 1994 through Ruffhouse Records with production handled by both The Goats and Joe "The Butcher" Nicolo. After the release of the first album, lead rapper Oatie Kato had left the group leaving Madd and Swayzack to continue the Goats as a duo. The album was not as critically successful as Tricks of the Shade, as many felt the content of this album was inferior to Tricks of the Shade, an assessment with which Noah Berlatsky disagreed. Original album artwork by Philadelphia artist Scott R. Johnston.
^Berlatsky, Noah (2014-04-19). "The 20 most underrated albums of all time". Salon. Retrieved 2017-09-15. This Philadelphia hip hop crew is largely forgotten, but anyone who remembers them seems to consider this, their second album, a catastrophic falling off. It doesn’t sound like that to me; on the contrary, “No Goats, No Glory” seems like a late but worthy entry in hip hop’s golden age; audacious, funny, arch with an idea in every booty-shake.