The Martyr Mantras contains many dance-oriented tracks, most of them with an electronic production. It is partly a collection of some of the songs that were released as one-off singles many months before (“No Clause 28” in 1988, “After the Love” in 1989, “Generations of Love” and “One On One” in 1990). The lead single was the Indian and house mash-up "Bow Down Mister" which reached the Top 30 in the UK Singles Chart.
George’s songwriting credits are also on another alias, as “Angela Dust”.
In a contemporaneous review in Keyboard, Jim Aikin described the album as "blue-eyed soul for the '90s". He added that "[George] updates his British R&B roots very effectively with hip-hop beats and techno tricks". Aikin also noted that, whatever the mood of any particular track, "you feel that George is sincere".
In a retrospective review for AllMusic, William Ruhlmann found the music to be "largely anonymous, if danceable", but singled out "Bow Down Mister" as an exception.