Later in 1963, Taylor formed The Pretty Things with vocalist Phil May and once again played his preferred guitar position. During a break from The Pretty Things after the release of their album, S.F. Sorrow (1968), Taylor produced Hawkwind's debut album, on which he also played guitar. His contribution to punk rock was a recording by Auntie Pus, and during the second half of the 1980s Taylor played guitar with the English post-punk band the Mekons. He recorded with Andre Williams in Chicago, Illinois for George Paulus' St. George Records. The core members of The Pretty Things remain in the band to this day, and released the Balboa Island album in 2007 on the Cote Basque record label.