Joseph-Monrose began his career playing for his local club in Bondy, AS Bondy, before moving to CRAF Liévin. He arrived at RC Lens in 2002. On July 20, 2008, he signed his first professional contract with the Pas-de-Calais-based side, which will keep him there until 2013. He was given the number 34 kit. He made his professional debut on October 13, 2008, in Lens' 1–0 win over En Avant Guingamp coming on as a substitute playing 20 minutes. On 11 January 2010, RC Lens loaned him to LB Châteauroux until 30 June 2010.