The title song was set to be released on John's previous album Tumbleweed Connection. However, it was set aside and would eventually be re-recorded and serve as the title track of this album. Previous versions of the song (from the Tumbleweed sessions with Mick Ronson on guitar) can still be found, specifically on the remastered Tumbleweed Connection CD.
When it was released in 'The Classic Years' collection, it was the first album not to feature any bonus tracks. One known track recorded at the time, "Rock Me when He's Gone," was released on Rare Masters a few years before. The song was written for and recorded by one of John's long-time friends, Long John Baldry. This was John's first album in which he plays his piano and no other keyboards. This was the first album in which Davey Johnstone played guitar for John, a role that would continue for many years and decades to come.
John, Johnstone, Dee Murray and Nigel Olsson, who would be the main musicians on the next album (Honky Chateau), would soon join with percussionist Ray Cooper and form the best-known line-up of his mid-1970s band. As with all John songs during this period, the lyrics were penned by his writing partner, Bernie Taupin. This was the last album to be recorded at London's Trident Studios. They relocated to Château d'Hérouville for the next three albums. Caleb Quaye and Roger Pope wouldn't play with John again until Rock of the Westies in 1975, following Murray and Olsson's departure from the band.
This was John's lowest charting album in the UK after his debut, only reaching #41. In the U.S., Madman Across the Water managed to reach #8 in early 1972 on the Billboard 200, and was certified gold in 1972. It was later certified platinum in 1993 and 2× platinum in 1998.
When this album was issued on cassette MCA swapped the places of "Razor Face" and "Rotten Peaches" on side one and two of the tape. The SACD version of the album contained a longer version of "Razor Face" which extended the song-ending jam to 6:42 instead of the early fade on the original album.
The song "Holiday Inn" was written for Adam Diaz. An additional verse in the recorded version that was originally part of the song was either omitted during recording or edited out of the final album version. It can, however, be heard on "unofficial" live recordings of the song from some of his concerts during this period, which have circulated among collectors.