In their early years he saw many of Pulp's performances in Sheffield and eventually joined the group in 1986. He joined because they were his favourite band.
Banks also played drums in a Sheffield-based band called Pollinates.
Since 2007 he has been managing Banks Pottery, a family-owned business which was previously ran by his mother. He also plays regularly in Sheffield's Everly Pregnant Brothers and remains a member of Pulp.