Yahaya started his profi career at Tema Youth in 2006. In 2009, Yahaya was from Tema Youth transferred to AEK Athens. Although he made some good appearances in the start of the 2009–2010 season, Yahaya fell out of favor with Dusan Bajevic quickly and was never featured again.
Signed by Maccabi Haifa in 2010. After a great half season with Maccabi, it was decided that Maccabi will sign Yahaya on a contract. In the first season with Maccabi Haifa Yahaya won the championship and lost in the cup final. Maccabi Haifa exercised Yahaya's contract option for the next three years.