The title refers to the part of Antarctica known as Victoria Land after Queen Victoria (and forming the British claim to the continent, currently dormant under international treaty). Several song titles seem to have polar themes (although not exclusively Antarctic), including "How to Bring a Blush to the Snow", "Feet-Like Fins", presumably about pinnipeds, "Throughout the Dark Months of April and May", which could be about the beginning of the South Polar winter, the obvious "Whales Tails" and "Oomingmak" which is an Inuit name for the muskox. "The Thinner the Air" could refer to the fact that much of the continent is more than 3 kilometers (2 mi) above sea level; at this altitude air becomes noticeably thinner. As is often the case with Fraser's vocals, the lyrics are indecipherable.
On its initial release in the UK the vinyl edition was a 12" disc which played at 45 rpm, which would be normal for EP rather than a full album which would normally play at 33⅓ rpm. This was due to difficulties in the mastering process in reproducing the minimal soundscapes. Some test pressings at 33⅓ rpm are known to exist.
An uncredited instrumental version of "Oomingmak" was used as a backing track for the credits at the end of the 4AD compilation video "Lonely Is An Eyesore". This instrumental version was later made available in the 1991 4AD singles box set.