On a Europe tour in the middle of 2004, the group was introduced to the British folk singer Vashti Bunyan in Edinburgh, Scotland, by Kieran Hebden (Four Tet). Bunyan finally contributed vocals to all of the songs except for "Baleen Sample". Avey Tare, Panda Bear and Deakin are present throughout the entire EP; Geologist, who could not join the tour because of his dayjob, is featured only on the song "Baleen Sample". They had three days to record three songs.
The first two songs are outtakes from the Sung Tongs recording sessions, re-recorded with Bunyan.
Bunyan says about the recordings:
My daughter says she can hear me smiling on the title track [...] and I was. I loved having the freedom to sing as I wanted. I was still finding my voice after burying it for years.