Vatsa was also an accomplished poet and writer, publishing eight poetry collections for adults and eleven for children, with titles such as Back Again at Wargate (1982), Reach for the Skies (1984) and Verses for Nigerian State Capitals (1973). His books are about ordinary people's lives and simple creatures, including the pidgin collection Tori for Geti Bow Leg (1981), his cultural picture book in Hausa, Bikin Suna, and a charming picture storybook entitled Stinger the Scorpion (1979).
Vatsa was a facilitator and patron of the arts in Nigeria, where he organized writing workshops for his fellow soldiers and their children and got their works published. He helped the Children's Literature Association of Nigeria with funds, built a Writers' Village for the Association of Nigerian Authors, and hosted their annual conferences.
The Writers' Village finally became a reality on the 24th of January, 2012, when the National Executive of the Association, led by the President, Prof. Remi Raji, performed a groundbreaking ceremony at the site. The Village has been named in Gen. Vatsa's honour.