In an interview with Pitchfork, vocalist/guitarist Kip Berman explained that the band "wanted the songs to exist in an immediate and instinctual place. The album sounds like we're taking away what we were hiding behind before. Lyrically, the first record had a lot of remembered experiences that I was looking back on and trying to make more clever, which can sound contrived. I like the idea of lyrics that don't get beyond themselves but catch you and make an impression. I think that's more emotionally compelling." 
February 2011 saw the announcement of Belong. The sophomore LP was preceded by the release of "Heart in Your Heartbreak" and "Belong", the title track.
The album's release will be followed by a national tour, supported by indie pop/electronic artist Twin Shadow. On March 10, 2011, The full album was posted on their website for streaming.
The album has been received positively by music critics, earning a 76 on review aggregator site Metacritic, indicating "generally favorable reviews".
On March 23, 2011, "Heart In Your Heartbreak" was performed on the Late Show with David Letterman. Tours across the United States, Europe, and United Kingdom saw the year out for the five-piece. In 2012, the band returned to Australia and New Zealand for the St. Jerome's Laneway Festival in January and February. After this, Japan, China, and Singapore were visited by the performers.