The title refers to the part of Antarctica known as Victoria Land after Queen Victoria (and forming the British claim to the continent, currently dormant under international treaty). As is often the case with Fraser's vocals, the lyrics are indecipherable.
On its initial release in the UK the vinyl edition was a 12" disc which played at 45 rpm, which would be normal for EP rather than a full album which would normally play at 33⅓ rpm. This was due to difficulties in the mastering process in reproducing the minimal soundscapes. Some test pressings at 33⅓ rpm are known to exist.
An uncredited instrumental version of "Oomingmak" was used as a backing track for the credits at the end of the 4AD compilation video "Lonely Is An Eyesore". This instrumental version was later made available in the 1991 4AD singles box set.