Born in San Michele Mondovì, Rosso's parents had attempted to send him to university, but at 19 he chose the trumpet over academia, and left home. After his employment in a nightclub was terminated by the police, he returned home, but soon after departed again to relaunch his career. He soon became one of the best-known jazz trumpeters in Italy, reaching the crest of his popularity in the 1960s. He became known in the UK in 1962 when his recording of "Concerto Disperato" was covered by Ken Thorne and his Orchestra and became a hit under the title "The Theme from 'The Legion's Last Patrol'". Rosso's original was quickly released on the Durium label and also made the charts, but was less successful than the cover. His 1965 worldwide hit "Il Silenzio" went to #1 in Italy, Germany, Austria, and Switzerland, and sold over five million copies by the end of 1967. It was awarded a gold disc. He also acted in the 1960s.
Rosso died of a tumor in 1994, at the age of 68.