He joined First Division Sheffield Wednesday in 1893 winning an FA Cup winners medal in 1896. They also won the Second Division title in 1900 and the Football League title in 1903 and 1904 while Langley was at the club.
Despite suffering a rib injury that curtailed his career in the top flight, Langley was appointed as player-manager of Hull City in 1905. In his first season in charge, City finished in fifth place in the second division. In 1908–09 he led them to fourth place. In 1909–10 they finished third, and only missed out on promotion to the top flight on goal average, losing 3–0 to promotion rivals Oldham in their final game of the season, having won eleven and drawn one of their previous twelve games.